00000040:00080000:0.0F:1783951232.353110:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0F:1783951232.610380:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944991232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951232.610480:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951232.610603:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944991232 00000100:00100000:2.0:1783951232.610612:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944991232 00000100:00100000:2.0:1783951232.610665:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783951232.610695:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944991232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783951232.610727:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1783951232.610775:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944991232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951232.610783:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783951232.610806:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944991360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951232.610831:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951232.610862:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944991360 00000100:00100000:2.0:1783951232.610866:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944991360 00000100:00100000:2.0:1783951232.610887:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783951232.610895:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944991360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951232.610907:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1783951232.610937:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944991360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951232.610943:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783951232.610973:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1783951232.610979:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e0248394700, transno 8589934596 00000004:00080000:2.0:1783951232.610990:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1783951232.611017:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944991360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951232.611358:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944991232:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0F:1783951232.611539:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951232.611880:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944991616:0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.611921:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951232.611952:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944992128:0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.611978:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951232.611995:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944992640:0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.612017:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951232.612037:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783951232.612042:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944991744:0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.612063:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951232.612081:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944992256:0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.612104:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951232.612333:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944992768:0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.612357:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951232.612386:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944992128 00000100:00100000:1.0:1783951232.612391:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944992128 00000100:00100000:1.0:1783951232.612432:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944991744 00000100:00100000:1.0:1783951232.612435:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944991744 00000100:00100000:1.0:1783951232.612453:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783951232.612460:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024919f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944992128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.612508:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024919f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944992128:12345-0@lo:400:kworker.0 Request processed in 47us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951232.612515:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783951232.612529:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783951232.612535:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024919c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944991744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.612564:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024919c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944991744:12345-0@lo:400:kworker.0 Request processed in 29us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951232.612582:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783951232.612603:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944992256 00000100:00100000:1.0:1783951232.612606:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944992256 00000100:00100000:1.0:1783951232.612632:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783951232.612638:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024919c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944992256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.612670:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024919c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944992256:12345-0@lo:400:kworker.0 Request processed in 32us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951232.612783:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783951232.612861:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944991744:0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.612874:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944992256:0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.612883:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944992128:0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.612940:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944992640 00000100:00100000:1.0:1783951232.612944:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944992640 00000100:00100000:1.0:1783951232.612983:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944992768 00000100:00100000:1.0:1783951232.612986:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944992768 00000100:00100000:1.0:1783951232.613007:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783951232.613012:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024919c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944992640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.613047:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024919c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607944992640:12345-0@lo:400:kworker.0 Request processed in 35us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951232.613053:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783951232.613065:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783951232.613071:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024919e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944992768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.613097:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024919e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607944992768:12345-0@lo:400:kworker.0 Request processed in 26us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951232.613102:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783951232.613395:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944991488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951232.613444:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951232.613468:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944992000:0@lo:400:kworker.0 00000100:00100000:2.0:1783951232.613488:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951232.613499:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944992512:0@lo:400:kworker.0 00000100:00100000:2.0:1783951232.613518:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951232.613527:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944993024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951232.613543:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951232.613561:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783951232.613567:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944991872:0@lo:400:kworker.0 00000100:00100000:2.0:1783951232.613585:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951232.613602:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944992384:0@lo:400:kworker.0 00000100:00100000:2.0:1783951232.613624:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951232.613637:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024919f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944992896:0@lo:400:kworker.0 00000100:00100000:2.0:1783951232.613658:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951232.614674:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944991488 00000100:00100000:2.0:1783951232.614692:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944991488 00000100:00100000:2.0:1783951232.614739:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944993024 00000100:00100000:2.0:1783951232.614743:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944993024 00000100:00100000:2.0:1783951232.614761:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783951232.614769:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944991488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783951232.614799:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1783951232.614850:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944991488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951232.614856:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783951232.614871:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783951232.614878:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944993024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783951232.614904:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783951232.614935:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944993024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951232.614941:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783951232.614996:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944991488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951232.615010:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944993024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951232.615057:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944991872 00000100:00100000:2.0:1783951232.615061:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944991872 00000100:00100000:2.0:1783951232.615092:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783951232.615098:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944991872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.615258:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944992000 00000100:00100000:1.0:1783951232.615263:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944992000 00000100:00100000:1.0:1783951232.615295:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944992512 00000100:00100000:1.0:1783951232.615299:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944992512 00000100:00100000:1.0:1783951232.615316:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944992384 00000100:00100000:1.0:1783951232.615319:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944992384 00000100:00100000:1.0:1783951232.615331:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944992896 00000100:00100000:1.0:1783951232.615334:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944992896 00000100:00100000:1.0:1783951232.615350:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783951232.615357:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944992000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.615456:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944992000:12345-0@lo:400:kworker.0 Request processed in 99us (1966us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951232.615463:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783951232.615477:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783951232.615483:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944992512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.615512:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607944992512:12345-0@lo:400:kworker.0 Request processed in 29us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951232.615518:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783951232.615530:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783951232.615537:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944992384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.615565:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944992384:12345-0@lo:400:kworker.0 Request processed in 29us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951232.615572:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783951232.615584:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783951232.615591:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944992896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.615640:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944992896:12345-0@lo:400:kworker.0 Request processed in 48us (1980us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951232.615655:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783951232.615736:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944991616 00000100:00100000:1.0:1783951232.615740:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944991616 00000100:00100000:1.0:1783951232.615769:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1783951232.615775:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+24:3652:x1870607944991616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.615808:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+24:3652:x1870607944991616:12345-0@lo:400:kworker.0 Request processed in 34us (3887us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951232.615814:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1783951232.615837:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783951232.615841:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951232.615872:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607944992768:0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.615882:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944991616:0@lo:400:kworker.0 00010000:00080000:1.0:1783951232.615897:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037d245c00 x1870607944992640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951232.615908:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607944992640:0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.615976:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944992384:0@lo:400:kworker.0 00010000:00080000:1.0:1783951232.615988:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024919f480 x1870607944992896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951232.615995:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024919f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944992896:0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.616005:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944992000:0@lo:400:kworker.0 00000100:00100000:1.0:1783951232.616016:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607944992512:0@lo:400:kworker.0 00000100:00100000:2.0:1783951232.620897:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944991872:12345-0@lo:400:kworker.0 Request processed in 5789us (7300us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951232.620912:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783951232.621079:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944991872:0@lo:400:kworker.0 00000001:00080000:1.0:1783951233.131721:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:1.0:1783951233.131741:0:17179:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e036d3a0780 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:1.0:1783951233.131746:0:17179:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e03720f3000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e036d3a0300 00000020:00080000:1.0:1783951233.131750:0:17179:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e03720f3300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e03719e0200 00010000:00010000:2.0:1783951233.131930:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f98ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951233.131944:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f98ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951233.131951:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f98ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951233.131957:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951233.131963:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f98ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951233.131971:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f98ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951233.132001:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e024692ed00) 00010000:00010000:2.0:1783951233.132004:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951233.132010:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f98ff lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951233.132015:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948800/0x7645c8e1169f98ff lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783951233.132081:0:17239:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:0.0:1783951233.132194:0:17239:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1783951233.312346:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951233.797385:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951233.797428:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951233.797449:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0F:1783951233.797536:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923948416 00000100:00100000:3.0:1783951233.797554:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923948416 00000100:00100000:3.0:1783951233.797621:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 169 00000100:00100000:3.0:1783951233.797632:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:2410:x1870607923948416:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951233.797699:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:2410:x1870607923948416:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 68us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951233.797707:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 169 00000100:00100000:1.0:1783951233.797929:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923948672 00000100:00100000:1.0:1783951233.797934:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923948672 00000100:00100000:1.0:1783951233.797988:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923948544 00000100:00100000:1.0:1783951233.797991:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923948544 00000100:00100000:1.0:1783951233.798015:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 76 00000100:00100000:1.0:1783951233.798023:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923948672:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951233.798063:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923948672:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 42us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951233.798070:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 76 00000100:00100000:1.0:1783951233.798083:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 77 00000100:00100000:1.0:1783951233.798089:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+13:2410:x1870607923948544:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951233.798115:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+13:2410:x1870607923948544:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 26us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951233.798122:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 77 00000100:00080000:0.0:1783951233.798234:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783951233.798239:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951233.807192:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951233.807228:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951233.807275:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951233.807307:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951233.807356:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923949184 00000100:00100000:3.0:1783951233.807381:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923949184 00000100:00100000:0.0:1783951233.807404:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951233.807444:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923949056 00000100:00100000:0.0:1783951233.807453:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923949056 00000100:00100000:3.0:1783951233.807489:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 78 00000100:00100000:3.0:1783951233.807505:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956fd71-c100-46a9-957b-d126f21246ff+5:2409:x1870607923949184:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951233.807547:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923948800 00000100:00100000:1.0:1783951233.807554:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923948800 00000100:00100000:1.0:1783951233.807596:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923948928 00000100:00100000:1.0:1783951233.807599:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923948928 00000100:00100000:1.0:1783951233.807617:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923949312 00000100:00100000:1.0:1783951233.807619:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923949312 00000100:00100000:3.0:1783951233.807639:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956fd71-c100-46a9-957b-d126f21246ff+5:2409:x1870607923949184:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 134us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951233.807646:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 33 00000100:00100000:1.0:1783951233.807661:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e04e128-5618-477b-951f-a759707c8cef+5:2409:x1870607923948928:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951233.807741:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:2.0:1783951233.807763:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e04e128-5618-477b-951f-a759707c8cef+5:2406:x1870607923948800:12345-192.168.202.33@tcp:9:kworker.0 00000020:00000080:2.0:1783951233.807794:0:19194:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f962e 00000100:00080000:2.0:1783951233.807810:0:19194:0:(import.c:65:import_set_state_nolock()) ffff9e02481c6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783951233.807855:0:19194:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1783951233.808019:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e04e128-5618-477b-951f-a759707c8cef+2:2406:x1870607923948800:12345-192.168.202.33@tcp:9:kworker.0 Request processed in 269us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951233.808028:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:2.0:1783951233.808045:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 30 00000100:00100000:2.0:1783951233.808054:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a956fd71-c100-46a9-957b-d126f21246ff+5:2406:x1870607923949312:12345-192.168.202.33@tcp:9:kworker.0 00000020:00000080:2.0:1783951233.808066:0:19194:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f966d 00000100:00080000:2.0:1783951233.808072:0:19194:0:(import.c:65:import_set_state_nolock()) ffff9e024762f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783951233.808095:0:19194:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1783951233.808180:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a956fd71-c100-46a9-957b-d126f21246ff+2:2406:x1870607923949312:12345-192.168.202.33@tcp:9:kworker.0 Request processed in 128us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951233.808187:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 30 00010000:00010000:2.0:1783951233.808238:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951233.808256:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783951233.808314:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783951233.808319:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783951233.808322:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783951233.808325:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951233.808532:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 79 00000100:00100000:0.0:1783951233.808541:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956fd71-c100-46a9-957b-d126f21246ff+6:2409:x1870607923949056:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951233.808584:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a956fd71-c100-46a9-957b-d126f21246ff+6:2409:x1870607923949056:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 44us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951233.808591:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 79 00000100:00100000:1.0:1783951233.808676:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e04e128-5618-477b-951f-a759707c8cef+5:2409:x1870607923948928:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 1018us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951233.808683:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 33 00000100:00100000:3.0:1783951233.815988:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 78 00000100:00100000:2.0:1783951233.816433:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951233.818969:0:19194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923949440 00000100:00100000:3.0:1783951233.818988:0:19194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923949440 00000100:00100000:3.0:1783951233.819090:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 31 00000100:00100000:3.0:1783951233.819113:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a956fd71-c100-46a9-957b-d126f21246ff+5:2406:x1870607923949440:12345-192.168.202.33@tcp:9:kworker.0 00000020:00000080:3.0:1783951233.820857:0:19194:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9674 00000100:00080000:3.0:1783951233.820892:0:19194:0:(import.c:65:import_set_state_nolock()) ffff9e0381192000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783951233.820972:0:19194:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00080000:2.0:1783951233.821840:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783951233.822202:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951233.826012:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a956fd71-c100-46a9-957b-d126f21246ff+2:2406:x1870607923949440:12345-192.168.202.33@tcp:9:kworker.0 Request processed in 5132us (7809us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951233.826036:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 31 00010000:00010000:1.0:1783951234.336578:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951235.360327:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951235.682419:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951235.682500:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923949568 00000100:00100000:3.0:1783951235.682511:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923949568 00000100:00100000:3.0:1783951235.682600:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 65 00000100:00100000:3.0:1783951235.682611:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+13:15610:x1870607923949568:12345-192.168.202.33@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1783951235.682720:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+13:15610:x1870607923949568:12345-192.168.202.33@tcp:60:lhsmtool_posix.0 Request processed in 111us (4094us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951235.682727:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 65 00000100:00080000:3.0:1783951235.682747:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951235.696429:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951235.696522:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923949696 00000100:00100000:1.0:1783951235.696532:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923949696 00000100:00100000:1.0:1783951235.696607:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 66 00000100:00100000:1.0:1783951235.696618:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+5:15610:x1870607923949696:12345-192.168.202.33@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1783951235.696773:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e128-5618-477b-951f-a759707c8cef+5:15610:x1870607923949696:12345-192.168.202.33@tcp:60:lhsmtool_posix.0 Request processed in 157us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951235.696781:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 66 00000100:00080000:2.0:1783951235.697263:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951235.712617:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951235.712735:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923949952 00000100:00100000:2.0:1783951235.712746:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923949952 00000100:00100000:2.0:1783951235.712823:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:2.0:1783951235.712835:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e128-5618-477b-951f-a759707c8cef+13:15610:x1870607923949952:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783951235.713080:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e128-5618-477b-951f-a759707c8cef+14:15610:x1870607923949952:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 247us (471us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1783951235.713102:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:0.0:1783951236.194455:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783951236.194480:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944993152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783951236.194551:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951236.194599:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944993152 00000100:00100000:0.0:1783951236.194606:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944993152 00000100:00100000:0.0:1783951236.194661:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783951236.194669:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944993152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783951236.194713:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783951236.194763:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944993152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951236.194770:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1783951236.194792:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951236.194827:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944993152:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783951236.385380:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951237.217758:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951237.217786:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944993280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951237.217865:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951237.218194:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944993280 00000100:00100000:0.0:1783951237.218203:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944993280 00000100:00080000:1.0:1783951237.218377:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951237.218890:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783951237.218905:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944993280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951237.218936:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783951237.219025:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944993280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951237.219114:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944993280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951237.222615:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1783951237.408639:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951237.728823:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944993408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951237.728899:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951237.729770:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944993536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951237.730514:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944993408 00000100:00100000:2.0:1783951237.730523:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944993408 00000100:00100000:1.0:1783951237.733356:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951237.733608:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944993536 00000100:00100000:1.0:1783951237.733609:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944994048:0@lo:400:kworker.0 00000100:00100000:3.0:1783951237.733615:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944993536 00000100:00100000:1.0:1783951237.733652:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951237.733660:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783951237.733669:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024919e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944993536:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951237.733669:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944994560:0@lo:400:kworker.0 00000100:00100000:1.0:1783951237.733688:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951237.733703:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944995072:0@lo:400:kworker.0 00000004:00000024:3.0:1783951237.733706:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783951237.733723:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951237.733747:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024919e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944993536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951237.733754:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783951237.733764:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944993536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951237.733778:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783951237.733780:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944995072 00000100:00100000:3.0:1783951237.733783:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944995072 00000100:00100000:1.0:1783951237.733791:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944993920:0@lo:400:kworker.0 00000100:00100000:3.0:1783951237.733814:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783951237.733819:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951237.733820:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024919ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944995072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951237.733838:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944994432:0@lo:400:kworker.0 00000100:00100000:3.0:1783951237.733850:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024919ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607944995072:12345-0@lo:400:kworker.0 Request processed in 31us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951237.733856:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783951237.733857:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951237.733874:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944994944:0@lo:400:kworker.0 00000100:00100000:1.0:1783951237.733894:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951237.733899:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944994048 00000100:00100000:3.0:1783951237.733902:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944994048 00000100:00100000:1.0:1783951237.733916:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607944995072:0@lo:400:kworker.0 00000100:00100000:3.0:1783951237.733931:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944994560 00000100:00100000:3.0:1783951237.733934:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944994560 00000100:00100000:1.0:1783951237.733936:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944994432 00000100:00100000:1.0:1783951237.733938:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944994432 00000100:00100000:1.0:1783951237.733953:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783951237.733959:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024919ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944994048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951237.733960:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783951237.733964:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024919d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944994432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951237.733998:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024919ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944994048:12345-0@lo:400:kworker.0 Request processed in 33us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951237.734005:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783951237.734017:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783951237.734023:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024919f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944994560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951237.734136:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783951237.734160:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944993408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951237.734181:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1783951237.734216:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944993408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (5318us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951237.734251:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783951237.734303:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944993408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951237.734350:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944993920 00000100:00100000:2.0:1783951237.734354:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944993920 00000100:00100000:2.0:1783951237.734382:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783951237.734556:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944994944 00000100:00100000:0.0:1783951237.734561:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944994944 00000100:00100000:0.0:1783951237.734590:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783951237.734597:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024919dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944994944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951237.734646:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+24:3655:x1870607944993920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951237.742707:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+24:3655:x1870607944993920:12345-0@lo:400:kworker.0 Request processed in 8307us (8875us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951237.742725:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:2.0:1783951237.742794:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783951237.742800:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783951237.742804:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951237.742822:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944993792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951237.742872:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951237.742902:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024856a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944994304:0@lo:400:kworker.0 00000100:00100000:2.0:1783951237.742925:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951237.742940:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944994816:0@lo:400:kworker.0 00000100:00100000:2.0:1783951237.742961:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951237.742985:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1783951237.742991:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024919f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944993664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951237.743009:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951237.743026:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944994176:0@lo:400:kworker.0 00000100:00100000:2.0:1783951237.743048:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951237.743064:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944994688:0@lo:400:kworker.0 00000100:00100000:2.0:1783951237.743084:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951237.743095:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1870607944995200:0@lo:400:kworker.0 00000100:00100000:2.0:1783951237.743112:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951237.743657:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944994304 00000100:00100000:2.0:1783951237.743666:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944994304 00000100:00100000:2.0:1783951237.743717:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944993664 00000100:00100000:2.0:1783951237.743721:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944993664 00000100:00100000:2.0:1783951237.743737:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783951237.743747:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3653:x1870607944994304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951237.743807:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3653:x1870607944994304:12345-0@lo:400:kworker.0 Request processed in 61us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951237.743814:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783951237.743828:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783951237.743836:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944993664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783951237.743862:0:17940:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1783951237.743895:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944993664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951237.743901:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783951237.743945:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024919f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944993664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951237.743955:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944994304:0@lo:400:kworker.0 00000100:00100000:2.0:1783951237.743984:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944993792 00000100:00100000:2.0:1783951237.743988:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944993792 00000100:00100000:2.0:1783951237.744013:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783951237.744019:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1870607944993792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783951237.744033:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1783951237.744065:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1870607944993792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951237.744071:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783951237.744100:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944993792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951237.744316:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024919d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944994432:12345-0@lo:400:kworker.0 Request processed in 10349us (10456us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951237.744326:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783951237.744353:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944994816 00000100:00100000:3.0:1783951237.744358:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944994816 00000100:00100000:3.0:1783951237.744391:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944994176 00000100:00100000:3.0:1783951237.744394:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944994176 00000100:00100000:3.0:1783951237.744407:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944994688 00000100:00100000:3.0:1783951237.744410:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944994688 00000100:00100000:3.0:1783951237.744420:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944995200 00000100:00100000:3.0:1783951237.744422:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944995200 00000100:00100000:3.0:1783951237.744438:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783951237.744443:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944994816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951237.744748:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1783951237.744757:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:2.0:1783951237.744792:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783951237.744797:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951237.744823:0:17199:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1783951237.744833:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783951237.744843:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944994176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951237.748318:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024919f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607944994560:12345-0@lo:400:kworker.0 Request processed in 14284us (14617us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951237.748318:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024919dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607944994944:12345-0@lo:400:kworker.0 Request processed in 13714us (14415us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951237.748335:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783951237.748335:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783951237.748405:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024856aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944993920:0@lo:400:kworker.0 00000100:00100000:1.0:1783951237.748422:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944994432:0@lo:400:kworker.0 00010000:00080000:1.0:1783951237.748438:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037e425880 x1870607944994944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951237.748449:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607944994944:0@lo:400:kworker.0 00000100:00100000:1.0:1783951237.748469:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944994048:0@lo:400:kworker.0 00000100:00100000:1.0:1783951237.748480:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944994560:0@lo:400:kworker.0 00000100:00100000:0.0:1783951237.748515:0:17200:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1783951237.748527:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783951237.748536:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944994688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951237.748683:0:20539:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:1.0:1783951237.748688:0:20539:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:1.0:1783951237.748762:0:20539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783951237.748771:0:20539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1870607944995200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951237.748785:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607944994176:12345-0@lo:400:kworker.0 Request processed in 3945us (5734us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951237.748794:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783951237.748806:0:20539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1870607944995200:12345-0@lo:400:kworker.0 Request processed in 38us (5693us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951237.748812:0:20539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783951237.748836:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607944994176:0@lo:400:kworker.0 00000100:00100000:3.0:1783951237.748891:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607944994816:12345-0@lo:400:kworker.0 Request processed in 4446us (5926us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951237.748897:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783951237.749002:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607944994688:12345-0@lo:400:kworker.0 Request processed in 467us (5915us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951237.749018:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783951237.749086:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607944994688:0@lo:400:kworker.0 00010000:00080000:2.0:1783951237.749101:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037e425f80 x1870607944995200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951237.749111:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1870607944995200:0@lo:400:kworker.0 00000100:00100000:2.0:1783951237.749126:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944994816:0@lo:400:kworker.0 00010000:00010000:1.0:1783951238.433719:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951238.914572:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951238.914620:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951238.914654:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951238.914672:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951238.914692:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951238.914714:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951238.914744:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923950336 00000100:00100000:3.0:1783951238.914753:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923950336 00000100:00100000:3.0:1783951238.914819:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923950592 00000100:00100000:3.0:1783951238.914835:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923950592 00000100:00100000:3.0:1783951238.914859:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923950208 00000100:00100000:3.0:1783951238.914862:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923950208 00000100:00100000:3.0:1783951238.914876:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923950720 00000100:00100000:3.0:1783951238.914879:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923950720 00000100:00100000:3.0:1783951238.914896:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 86 00000100:00100000:3.0:1783951238.914906:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923950336:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951238.914993:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923950336:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 87us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951238.915001:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 86 00000100:00100000:3.0:1783951238.915019:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 87 00000100:00100000:3.0:1783951238.915025:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956fd71-c100-46a9-957b-d126f21246ff+6:2410:x1870607923950592:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951238.915052:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956fd71-c100-46a9-957b-d126f21246ff+6:2410:x1870607923950592:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 27us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951238.915185:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 88 00000100:00100000:2.0:1783951238.915208:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+14:2410:x1870607923950208:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951238.915254:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e128-5618-477b-951f-a759707c8cef+14:2410:x1870607923950208:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 62us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951238.915261:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 88 00000100:00100000:2.0:1783951238.915277:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 89 00000100:00100000:2.0:1783951238.915286:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a956fd71-c100-46a9-957b-d126f21246ff+5:2410:x1870607923950720:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951238.915320:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a956fd71-c100-46a9-957b-d126f21246ff+5:2410:x1870607923950720:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 38us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951238.915326:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 89 00000100:00100000:2.0:1783951238.915347:0:19194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923950464 00000100:00100000:2.0:1783951238.915350:0:19194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923950464 00000100:00100000:2.0:1783951238.915383:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 37 00000100:00100000:2.0:1783951238.915392:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923950464:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951238.915419:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e04e128-5618-477b-951f-a759707c8cef+5:2410:x1870607923950464:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 30us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951238.915426:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 37 00000100:00080000:2.0:1783951238.915444:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783951238.915448:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783951238.915450:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951238.915723:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 87 00000100:00100000:1.0:1783951238.916329:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923950080 00000100:00100000:1.0:1783951238.916336:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923950080 00000100:00100000:1.0:1783951238.916382:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 171 00000100:00100000:1.0:1783951238.916390:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:2410:x1870607923950080:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951238.916441:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:2410:x1870607923950080:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 51us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951238.916447:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 171 00000040:00080000:3.0:1783951239.010383:0:17234:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783951239.010394:0:17234:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783951239.010415:0:17234:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1783951239.010423:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00080000:1.0:1783951239.270122:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1783951239.270137:0:17179:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:0.0:1783951239.270218:0:17239:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:0.0:1783951239.270230:0:17239:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000001:00100000:0.0:1783951239.270369:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a956fd71-c100-46a9-957b-d126f21246ff 00000020:00000080:0.0:1783951239.270376:0:18703:0:(genops.c:906:class_export_put()) final put ffff9e024762e000/a956fd71-c100-46a9-957b-d126f21246ff 00000001:00100000:0.0:1783951239.270398:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e04e128-5618-477b-951f-a759707c8cef 00000020:00000080:0.0:1783951239.270400:0:18703:0:(genops.c:906:class_export_put()) final put ffff9e02481c3000/6e04e128-5618-477b-951f-a759707c8cef 00000020:00000080:2.0:1783951239.271137:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024762e000/a956fd71-c100-46a9-957b-d126f21246ff for lustre-OST0000 00000020:00000080:2.0:1783951239.271239:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02481c3000/6e04e128-5618-477b-951f-a759707c8cef for lustre-OST0000 00000020:00000080:2.0:1783951239.271284:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e024762f000 for lustre-OST0000 00000020:00000080:2.0:1783951239.271289:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e02481c6000 for lustre-OST0000 00000001:00100000:2.0:1783951239.277753:0:19522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a956fd71-c100-46a9-957b-d126f21246ff 00000020:00000080:2.0:1783951239.277763:0:19522:0:(genops.c:906:class_export_put()) final put ffff9e0246bc9000/a956fd71-c100-46a9-957b-d126f21246ff 00000020:00000080:3.0:1783951239.289667:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246bc9000/a956fd71-c100-46a9-957b-d126f21246ff for lustre-OST0001 00000020:00000080:3.0:1783951239.289753:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0381192000 for lustre-OST0001 00010000:00010000:0.0:1783951239.457125:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783951240.330111:0:20577:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 10:00:38 (1783951238) 00010000:00010000:1.0:1783951240.480529:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951241.312566:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944995328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951241.312638:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951241.312775:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944995328 00000100:00100000:1.0:1783951241.312784:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944995328 00000100:00100000:1.0:1783951241.312844:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783951241.312855:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944995328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783951241.312886:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1783951241.312978:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951241.319834:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944995328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6969us (7184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951241.319862:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783951241.324708:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944995328:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783951241.505246:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951242.336949:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783951242.336974:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944995456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951242.337049:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951242.339696:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944995456 00000100:00100000:0.0:1783951242.339710:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944995456 00000100:00080000:2.0:1783951242.339795:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951242.339839:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783951242.339852:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024919ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944995456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951242.339881:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783951242.339973:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024919ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607944995456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (2923us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951242.339981:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783951242.340026:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607944995456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783951242.528832:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783951242.592972:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783951242.848670:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944995584:0@lo:400:kworker.0 00000100:00100000:0.0:1783951242.848916:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944995712:0@lo:400:kworker.0 00000100:00100000:1.0:1783951242.849033:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944995840:0@lo:400:kworker.0 00000100:00100000:2.0:1783951242.850384:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944995968:0@lo:400:kworker.0 00000100:00100000:0.0:1783951242.858666:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951242.858753:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944996224:0@lo:400:kworker.0 00000100:00100000:0.0:1783951242.858795:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951242.858817:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944996736:0@lo:400:kworker.0 00000100:00100000:0.0:1783951242.858866:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951242.858888:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0349482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944997248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951242.858912:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951242.859005:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944995712 00000100:00100000:0.0:1783951242.859012:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944995712 00000100:00100000:0.0:1783951242.859055:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944996224 00000100:00100000:0.0:1783951242.859057:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944996224 00000100:00100000:0.0:1783951242.859072:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783951242.859080:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944995712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951242.859133:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607944995712:12345-0@lo:400:kworker.0 Request processed in 53us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951242.859168:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783951242.859196:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783951242.859203:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944996224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951242.859233:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944996224:12345-0@lo:400:kworker.0 Request processed in 31us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951242.859239:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783951242.859261:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944996736 00000100:00100000:0.0:1783951242.859266:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944996736 00000100:00100000:0.0:1783951242.859301:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783951242.859308:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944996736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951242.861546:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607944996736:12345-0@lo:400:kworker.0 Request processed in 2230us (2670us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951242.861559:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1783951242.861622:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951242.861663:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607944995712:0@lo:400:kworker.0 00000100:00100000:0.0:1783951242.861696:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944996224:0@lo:400:kworker.0 00000100:00100000:0.0:1783951242.861707:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607944996736:0@lo:400:kworker.0 00000100:00100000:0.0:1783951242.861773:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944997248 00000100:00100000:0.0:1783951242.861780:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944997248 00000100:00100000:0.0:1783951242.861824:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783951242.861832:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944997248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951242.861861:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1783951242.861905:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944997248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (2991us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951242.861912:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1783951242.861925:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951242.861950:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0349482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944997248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951242.865626:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951242.865990:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944996480:0@lo:400:kworker.0 00000100:00100000:2.0:1783951242.866035:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951242.866378:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607944996992:0@lo:400:kworker.0 00000100:00100000:2.0:1783951242.866408:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951242.866434:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944996992 00000100:00100000:2.0:1783951242.866441:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944996992 00000100:00100000:2.0:1783951242.866514:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783951242.866524:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607944996992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951242.866575:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607944996992:12345-0@lo:400:kworker.0 Request processed in 53us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951242.866583:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1783951242.866610:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951242.866640:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607944996992:0@lo:400:kworker.0 00000100:00100000:2.0:1783951242.866648:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944997504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951242.866674:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951242.866706:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951242.866713:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944997632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951242.866739:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951242.866776:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944997632 00000100:00100000:2.0:1783951242.866780:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944997632 00000100:00100000:2.0:1783951242.866809:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783951242.866817:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944997632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783951242.866845:0:17940:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783951242.866879:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944997632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951242.866899:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783951242.866933:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944997632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951242.866972:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944997504 00000100:00100000:2.0:1783951242.866976:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944997504 00000100:00100000:2.0:1783951242.867011:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783951242.867019:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944997504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951242.867033:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1783951242.867069:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944997504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951242.867075:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1783951242.867089:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951242.867110:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944997504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951242.867395:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944995968 00000100:00100000:0.0:1783951242.867401:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944995968 00000100:00100000:0.0:1783951242.867481:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944996480 00000100:00100000:0.0:1783951242.867485:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944996480 00000100:00100000:0.0:1783951242.867515:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783951242.867521:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024818ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944996480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951242.867594:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783951242.867601:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944995968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951242.867650:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024818ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944996480:12345-0@lo:400:kworker.0 Request processed in 129us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951242.867656:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783951242.867723:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607944995968:12345-0@lo:400:kworker.0 Request processed in 123us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951242.867729:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783951242.867815:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607944995968:0@lo:400:kworker.0 00000100:00100000:2.0:1783951242.867823:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944996480:0@lo:400:kworker.0 00000100:00100000:3.0:1783951242.869487:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951242.869579:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944996096:0@lo:400:kworker.0 00000100:00100000:3.0:1783951242.869659:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951242.869688:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944996608:0@lo:400:kworker.0 00000100:00100000:3.0:1783951242.869732:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951242.869759:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944997120:0@lo:400:kworker.0 00000100:00100000:3.0:1783951242.869785:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951242.869832:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944996096 00000100:00100000:3.0:1783951242.869842:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944996096 00000100:00100000:3.0:1783951242.869898:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944996608 00000100:00100000:3.0:1783951242.869901:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944996608 00000100:00100000:0.0:1783951242.870060:0:20539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944997120 00000100:00100000:0.0:1783951242.870065:0:20539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944997120 00000100:00100000:0.0:1783951242.870114:0:20539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783951242.870124:0:20539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944996096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951242.870233:0:20539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607944996096:12345-0@lo:400:kworker.0 Request processed in 101us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951242.870250:0:20539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783951242.870272:0:20539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783951242.870278:0:20539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944996608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951242.870311:0:20539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607944996608:12345-0@lo:400:kworker.0 Request processed in 34us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951242.870317:0:20539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783951242.870329:0:20539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783951242.870335:0:20539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944997120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951242.870363:0:20539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607944997120:12345-0@lo:400:kworker.0 Request processed in 28us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951242.870368:0:20539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1783951242.870387:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783951242.870809:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037e424e00 x1870607944997120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951242.870826:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607944997120:0@lo:400:kworker.0 00000100:00100000:3.0:1783951242.870861:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607944996096:0@lo:400:kworker.0 00000100:00100000:3.0:1783951242.870872:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944996608:0@lo:400:kworker.0 00000100:00100000:2.0:1783951242.871166:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944995584 00000100:00100000:2.0:1783951242.871184:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944995584 00000100:00100000:2.0:1783951242.871250:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1783951242.871261:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+24:3655:x1870607944995584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951242.871320:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b0a9ba1e-8c11-4522-a460-4e640633581c+24:3655:x1870607944995584:12345-0@lo:400:kworker.0 Request processed in 62us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951242.871337:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783951242.871504:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951242.871521:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944995584:0@lo:400:kworker.0 00000100:00100000:1.0:1783951242.871585:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944996352:0@lo:400:kworker.0 00000100:00100000:2.0:1783951242.871656:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944995840 00000100:00100000:2.0:1783951242.871662:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944995840 00000100:00100000:2.0:1783951242.871739:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783951242.871748:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024919ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944995840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951242.875218:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024919ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607944995840:12345-0@lo:400:kworker.0 Request processed in 3266us (3518us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951242.875247:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783951242.881078:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951242.881184:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944996864:0@lo:400:kworker.0 00000100:00100000:1.0:1783951242.881222:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951242.881247:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024919d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944997376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951242.881274:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951242.881471:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944997376 00000100:00100000:3.0:1783951242.881486:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944997376 00000100:00100000:3.0:1783951242.881569:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783951242.881582:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024919fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944997376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783951242.881635:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1783951242.881738:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024919fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944997376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 158us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951242.881747:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783951242.882282:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607944995840:0@lo:400:kworker.0 00000100:00100000:3.0:1783951242.882490:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024919d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944997376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951242.882575:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944996352 00000100:00100000:0.0:1783951242.882584:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944996352 00000100:00100000:0.0:1783951242.882649:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783951242.882662:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024919df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944996352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951242.882690:0:20539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944996864 00000100:00100000:2.0:1783951242.882698:0:20539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944996864 00000100:00100000:0.0:1783951242.882774:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024919df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944996352:12345-0@lo:400:kworker.0 Request processed in 115us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951242.882783:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783951242.882875:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944996352:0@lo:400:kworker.0 00000100:00100000:2.0:1783951242.882968:0:20539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783951242.882984:0:20539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024919d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944996864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951242.883369:0:20539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024919d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944996864:12345-0@lo:400:kworker.0 Request processed in 247us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951242.883378:0:20539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1783951242.883571:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783951242.885603:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037e425880 x1870607944996864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951242.885630:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944996864:0@lo:400:kworker.0 00010000:00010000:0.0:1783951243.552402:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951243.786942:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951243.787277:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923950976 00000100:00100000:0.0:1783951243.787290:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923950976 00000100:00100000:0.0:1783951243.787386:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:0.0:1783951243.787401:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e04e128-5618-477b-951f-a759707c8cef+13:16373:x1870607923950976:12345-192.168.202.33@tcp:35:umount.0 00000001:00080000:0.0:1783951243.788073:0:17202:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00080000:1.0:1783951243.788378:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951243.789079:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e04e128-5618-477b-951f-a759707c8cef+15:16373:x1870607923950976:12345-192.168.202.33@tcp:35:umount.0 Request processed in 1676us (2145us total) trans 8589934625 rc 0/0 00000100:00100000:0.0:1783951243.789100:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 13 00000020:00080000:0.0:1783951243.789107:0:17202:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783951243.813338:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951243.813420:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951243.813456:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923951104 00000100:00100000:1.0:1783951243.813473:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923951104 00000100:00100000:2.0:1783951243.813503:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923951232 00000100:00100000:1.0:1783951243.813563:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:1.0:1783951243.813577:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349481180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:2408:x1870607923951104:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951243.813607:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951243.813633:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247a67400/0x7645c8e1169f960b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f959 expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951243.813654:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951243.813666:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923951232 00000100:00100000:2.0:1783951243.813731:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:1.0:1783951243.813742:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349481180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:2408:x1870607923951104:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 159us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951243.813747:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbc1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+13:2409:x1870607923951232:12345-192.168.202.33@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1783951243.813756:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3 00010000:00010000:2.0:1783951243.813761:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951243.813773:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247b5d200/0x7645c8e1169f9612 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f98a expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951243.813785:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951243.813811:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbc1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+11:2409:x1870607923951232:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 70us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951243.813829:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:3.0:1783951243.814500:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951243.815218:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923951360 00000100:00100000:2.0:1783951243.815227:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923951360 00000100:00100000:2.0:1783951243.815296:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:2.0:1783951243.815309:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349481c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+11:2407:x1870607923951360:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951243.815323:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951243.815341:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0343608a00/0x7645c8e1169f96cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa40 expref: 11 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951243.815357:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951243.815409:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349481c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+10:2407:x1870607923951360:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 103us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951243.815429:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:3.0:1783951243.816068:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951243.816209:0:19194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923951488 00000100:00100000:0.0:1783951243.816216:0:19194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923951488 00000100:00080000:2.0:1783951243.816276:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951243.816287:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 32 00000100:00100000:0.0:1783951243.816297:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e04e128-5618-477b-951f-a759707c8cef+5:2406:x1870607923951488:12345-192.168.202.33@tcp:9:umount.0 00000020:00000080:0.0:1783951243.816341:0:19194:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9635 00000100:00080000:0.0:1783951243.816352:0:19194:0:(import.c:65:import_set_state_nolock()) ffff9e02478fc800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783951243.816389:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1783951243.816408:0:19194:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1783951243.816599:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e04e128-5618-477b-951f-a759707c8cef+2:2406:x1870607923951488:12345-192.168.202.33@tcp:9:umount.0 Request processed in 303us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951243.816606:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 32 00000100:00100000:3.0:1783951243.826708:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951243.826827:0:20540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923952384 00000100:00100000:0.0:1783951243.826838:0:20540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923952384 00000100:00100000:0.0:1783951243.826928:0:20540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 67 00000100:00100000:0.0:1783951243.826940:0:20540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6e04e128-5618-477b-951f-a759707c8cef+15:2406:x1870607923952384:12345-192.168.202.33@tcp:39:umount.0 00000020:00000080:0.0:1783951243.826990:0:20540:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9620 00000020:00010000:0.0:1783951243.827013:0:20540:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e02481c5000: total 0 00000100:00080000:0.0:1783951243.827018:0:20540:0:(import.c:65:import_set_state_nolock()) ffff9e02481c4800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783951243.827052:0:20540:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934625 00000100:00100000:0.0:1783951243.827313:0:20540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6e04e128-5618-477b-951f-a759707c8cef+14:2406:x1870607923952384:12345-192.168.202.33@tcp:39:umount.0 Request processed in 373us (618us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1783951243.827322:0:20540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 67 00000020:00010000:1.0:1783951243.827865:0:17188:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e02481c5000: total 0 00010000:00010000:1.0:1783951243.827869:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951243.827969:0:17188:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e02481c5000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1783951243.828016:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e024692ed00) 00010000:00010000:1.0:1783951243.828019:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783951243.828029:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e9000/0x7645c8e1169f98d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fada expref: 13 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951243.828052:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e024692eb00) 00010000:00010000:1.0:1783951243.828053:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951243.828056:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382144800/0x7645c8e1169f96eb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa47 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951243.828067:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e0247826d00) 00010000:00010000:1.0:1783951243.828069:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783951243.828071:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03427e8800/0x7645c8e1169f97cb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa86 expref: 11 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951243.828085:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:1.0:1783951243.828087:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783951243.828097:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247b5c600/0x7645c8e1169f987a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fac5 expref: 10 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951243.828107:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:1.0:1783951243.828109:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783951243.828111:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247949200/0x7645c8e1169f9849 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fab0 expref: 9 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951243.828120:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e03438c0400) 00010000:00010000:1.0:1783951243.828121:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783951243.828123:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3200/0x7645c8e1169f9930 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fafd expref: 8 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951243.828132:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e03438c0300) 00010000:00010000:1.0:1783951243.828134:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951243.828136:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e03413c2600/0x7645c8e1169f9707 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa4e expref: 7 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951243.828160:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247826600) 00010000:00010000:1.0:1783951243.828162:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951243.828173:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247948600/0x7645c8e1169f9746 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa5c expref: 6 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951243.828186:0:17188:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e02481c5000, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1783951243.828200:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951243.828202:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951243.828204:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951243.869792:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951243.869907:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923952512 00000100:00100000:0.0:1783951243.869918:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923952512 00000100:00100000:0.0:1783951243.870022:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 68 00000100:00100000:0.0:1783951243.870033:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024919d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+5:2406:x1870607923952512:12345-192.168.202.33@tcp:39:umount.0 00000020:00000080:0.0:1783951243.870074:0:19450:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9627 00000100:00080000:0.0:1783951243.870091:0:19450:0:(import.c:65:import_set_state_nolock()) ffff9e02481c3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783951243.870124:0:19450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1783951243.870488:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024919d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e128-5618-477b-951f-a759707c8cef+3:2406:x1870607923952512:12345-192.168.202.33@tcp:39:umount.0 Request processed in 457us (709us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1783951243.870497:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 68 00010000:00010000:1.0:1783951243.870973:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783951243.871354:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951244.038284:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951244.038341:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951244.038465:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923952640 00000100:00100000:0.0:1783951244.038477:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923952640 00000100:00100000:0.0:1783951244.038572:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923952768 00000100:00100000:0.0:1783951244.038576:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923952768 00000100:00100000:0.0:1783951244.038608:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 96 00000100:00100000:0.0:1783951244.038620:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956fd71-c100-46a9-957b-d126f21246ff+6:2409:x1870607923952640:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951244.038725:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956fd71-c100-46a9-957b-d126f21246ff+6:2409:x1870607923952640:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 107us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951244.038734:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 96 00000100:00100000:0.0:1783951244.038768:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 97 00000100:00100000:0.0:1783951244.038775:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956fd71-c100-46a9-957b-d126f21246ff+5:2409:x1870607923952768:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951244.038805:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956fd71-c100-46a9-957b-d126f21246ff+5:2409:x1870607923952768:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 30us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951244.038812:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 97 00000100:00080000:1.0:1783951244.039026:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951244.039032:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783951244.576480:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951245.589622:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951245.589682:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951245.589719:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951245.589787:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923952896 00000100:00100000:0.0:1783951245.589802:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923952896 00000100:00100000:1.0:1783951245.589846:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923953152 00000100:00100000:2.0:1783951245.589855:0:18355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923953024 00000100:00100000:2.0:1783951245.589860:0:18355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923953024 00000100:00100000:1.0:1783951245.589860:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923953152 00000100:00100000:0.0:1783951245.589893:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:0.0:1783951245.589962:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349481500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+12:2408:x1870607923952896:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951245.590012:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951245.590037:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247b5ca00/0x7645c8e1169f964a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f9c9 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951245.590060:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951245.590129:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349481500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+11:2408:x1870607923952896:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 172us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951245.592179:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:1.0:1783951245.592216:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349483b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+11:2408:x1870607923953152:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951245.592238:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951245.592265:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0343609e00/0x7645c8e1169f9690 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa39 expref: 11 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951245.592285:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951245.592341:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349483b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+10:2408:x1870607923953152:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 149us (2658us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951245.592350:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:2.0:1783951245.595442:0:18355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:2.0:1783951245.595494:0:18355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349483480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+9:2408:x1870607923953024:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951245.595521:0:18355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951245.595549:0:18355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247b5da00/0x7645c8e1169f9651 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f9fa expref: 9 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951245.595569:0:18355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951245.595693:0:18355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349483480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+8:2408:x1870607923953024:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 233us (5971us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951245.595723:0:18355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:0.0:1783951245.604902:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 6 00010000:00010000:1.0:1783951245.605097:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951245.611759:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951245.613244:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923953408 00000100:00100000:1.0:1783951245.613262:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923953408 00000100:00100000:1.0:1783951245.613355:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 69 00000100:00100000:1.0:1783951245.613367:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956fd71-c100-46a9-957b-d126f21246ff+6:2406:x1870607923953408:12345-192.168.202.33@tcp:39:umount.0 00000020:00000080:1.0:1783951245.613427:0:19450:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f965f 00000020:00010000:1.0:1783951245.613439:0:19450:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e02478f9000: total 0 00000100:00080000:1.0:1783951245.613444:0:19450:0:(import.c:65:import_set_state_nolock()) ffff9e02478fb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783951245.613479:0:19450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:1.0:1783951245.613660:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a956fd71-c100-46a9-957b-d126f21246ff+5:2406:x1870607923953408:12345-192.168.202.33@tcp:39:umount.0 Request processed in 294us (1914us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1783951245.613669:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 69 00000020:00010000:0.0:1783951245.614050:0:17188:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e02478f9000: total 0 00010000:00010000:0.0:1783951245.614115:0:17188:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e02478f9000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783951245.614211:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247826600) 00010000:00010000:0.0:1783951245.614216:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783951245.614227:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0382145c00/0x7645c8e1169f9754 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fa63 expref: 4 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951245.614256:0:17188:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e02478f9000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1783951245.614270:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951245.614272:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951245.614274:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951245.620455:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951245.620564:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923953536 00000100:00100000:0.0:1783951245.620577:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923953536 00000100:00100000:0.0:1783951245.620655:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 70 00000100:00100000:0.0:1783951245.620668:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024919f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956fd71-c100-46a9-957b-d126f21246ff+5:2406:x1870607923953536:12345-192.168.202.33@tcp:39:umount.0 00000020:00000080:0.0:1783951245.620723:0:17200:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9666 00000100:00080000:0.0:1783951245.620736:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9e036c57d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783951245.620768:0:17200:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1783951245.621189:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024919f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a956fd71-c100-46a9-957b-d126f21246ff+3:2406:x1870607923953536:12345-192.168.202.33@tcp:39:umount.0 Request processed in 521us (746us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1783951245.621208:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 70 00010000:00010000:1.0:1783951245.621376:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951245.650583:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951245.650687:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923953792 00000100:00100000:2.0:1783951245.650699:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923953792 00000100:00100000:2.0:1783951245.650801:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 173 00000100:00100000:2.0:1783951245.650815:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+7:2406:x1870607923953792:12345-192.168.202.33@tcp:251:umount.0 00000020:00000080:2.0:1783951245.651048:0:17193:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f95fd 00000020:00010000:2.0:1783951245.651338:0:17193:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e02481c0000: total 0 00000100:00080000:2.0:1783951245.651346:0:17193:0:(import.c:65:import_set_state_nolock()) ffff9e02481c4000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1783951245.651481:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e+3:2406:x1870607923953792:12345-192.168.202.33@tcp:251:umount.0 Request processed in 667us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951245.651492:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 173 00000020:00010000:0.0:1783951245.651604:0:17188:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e02481c0000: total 0 00010000:00010000:0.0:1783951245.651609:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951245.651683:0:17188:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e02481c0000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783951245.651727:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247a67c00/0x7645c8e1169f9604 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3f952 expref: 2 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951245.651744:0:17188:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e02481c0000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1783951245.651755:0:17188:0:(genops.c:906:class_export_put()) final put ffff9e02481c0000/ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e 00010000:00010000:0.0:1783951245.651774:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951245.651776:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951245.651778:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783951245.652342:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02481c0000/ed8f332b-c8cc-4e01-a4be-c5bc1fb50e0e for MGS 00000020:00000080:2.0:1783951245.652398:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e02481c4000 for MGS 00000100:00100000:3.0:1783951246.434425:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0349483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944997760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951246.434510:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951246.441651:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944997760 00000100:00100000:2.0:1783951246.441674:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944997760 00000100:00100000:2.0:1783951246.441774:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783951246.441808:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944997760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951246.441860:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783951246.441975:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607944997760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 190us (7463us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951246.441984:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783951246.442081:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0349483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607944997760:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783951246.444008:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783951246.633895:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783951247.281035:0:20772:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783951247.293302:0:20772:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1783951247.293392:0:20772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f91c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f91c7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951247.293407:0:20772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f91c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f91c7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951247.293415:0:20772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f91c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f91c7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951247.293422:0:20772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f91c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f91c7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951247.293442:0:20772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783951247.293448:0:20772:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783951247.293483:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783951247.293489:0:20772:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783951247.293496:0:20772:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783951247.293529:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9e037e5d9800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783951247.294093:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1870607944997888:0@lo:39:umount.0 00000100:00100000:3.0:1783951247.294212:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951247.295825:0:20539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944997888 00000100:00100000:3.0:1783951247.295838:0:20539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944997888 00000100:00100000:3.0:1783951247.295904:0:20539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783951247.295916:0:20539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1870607944997888:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783951247.295955:0:20539:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f91f1 00000100:00080000:3.0:1783951247.295967:0:20539:0:(import.c:65:import_set_state_nolock()) ffff9e037e5d9000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783951247.296078:0:20539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3651:x1870607944997888:12345-0@lo:39:umount.0 Request processed in 163us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951247.296086:0:20539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:3.0:1783951247.296098:0:20539:0:(genops.c:906:class_export_put()) final put ffff9e037e5de800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1783951247.296161:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e037e5de800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783951247.296217:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e037e5d9000 for lustre-MDT0000 00010000:00010000:3.0:1783951247.296548:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951247.296557:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f91c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f91c7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.296569:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5d000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783951247.296589:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f91c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f91c7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.296598:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f91c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f91c7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951247.296604:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f91c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f91c7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951247.296608:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783951247.296610:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783951247.296612:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783951247.296644:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f91c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f91c7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.296647:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951247.296675:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f91c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f91c7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.296683:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247b5d000/0x7645c8e1169f91c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f91c7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.296696:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951247.296697:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0349480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0a9ba1e-8c11-4522-a460-4e640633581c:3653:1870607944998016:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951247.296698:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951247.296699:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783951247.296743:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e037e5d9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783951247.296752:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951247.296753:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1870607944997888:0@lo:39:umount.0 00000100:00100000:2.0:1783951247.296807:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944998016 00000100:00100000:2.0:1783951247.296812:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944998016 00000100:00100000:2.0:1783951247.296865:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783951247.296873:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248568380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+24:3653:x1870607944998016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783951247.296901:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951247.296917:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247a66200/0x7645c8e1169f91c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f91c0 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951247.297048:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951247.297081:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248568380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0a9ba1e-8c11-4522-a460-4e640633581c+23:3653:x1870607944998016:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951247.297088:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783951247.297118:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0349480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b0a9ba1e-8c11-4522-a460-4e640633581c:3653:1870607944998016:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1783951247.298061:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783951247.298067:0:20772:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783951247.298073:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783951247.298384:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951247.298985:0:20772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f9111 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9118 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951247.299001:0:20772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f9111 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9118 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951247.299020:0:20772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f9111 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f9118 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951247.299028:0:20772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f9111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f9118 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951247.299048:0:20772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951247.299056:0:20772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9524 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f952b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951247.299063:0:20772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9524 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f952b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.299069:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951247.299070:0:20772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9524 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f952b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951247.299076:0:20772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f952b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.299077:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f9111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f9118 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.299097:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66800 already unused, calling callback (ffffffffc1466c20) 00010000:00010000:1.0:1783951247.299098:0:20772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:3.0:1783951247.299101:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f9111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f9118 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951247.299104:0:20772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f96c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f96c8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.299111:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f9111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f9118 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951247.299111:0:20772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f96c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f96c8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951247.299117:0:20772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f96c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f96c8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951247.299119:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f9111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f9118 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951247.299125:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783951247.299128:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1783951247.299171:0:20772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f96c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f96c8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951247.299181:0:20772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951247.299187:0:20772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f9103 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f910a expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951247.299193:0:20772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f9103 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f910a expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.299195:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f9111 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f9118 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951247.299200:0:20772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f9103 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f910a expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.299202:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951247.299206:0:20772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f9103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f910a expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951247.299213:0:20772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1783951247.299215:0:20772:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1783951247.299220:0:20772:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1783951247.299227:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f9111 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f9118 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.299233:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247a66800/0x7645c8e1169f9111 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f9118 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.299246:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783951247.299249:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f952b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783951247.299253:0:20772:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00010000:00010000:3.0:1783951247.299254:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247948e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783951247.299257:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f952b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1783951247.299258:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1783951247.299263:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951247.299269:0:20772:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00010000:00010000:3.0:1783951247.299273:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f952b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783951247.299278:0:20772:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e02478fc000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:3.0:1783951247.299280:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f952b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783951247.299284:0:20772:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e0246682800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:3.0:1783951247.299285:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1783951247.299288:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1783951247.299289:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00080000:1.0:1783951247.299289:0:20772:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e0343db1800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783951247.299294:0:20772:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e0246ae1800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1783951247.299303:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9524 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f952b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.299308:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1783951247.299309:0:20772:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9e02478f9000 a956fd71-c100-46a9-957b-d126f21246ff 192.168.202.33@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00010000:00010000:3.0:1783951247.299314:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9524 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f952b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783951247.299314:0:20772:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9e02481c5000 6e04e128-5618-477b-951f-a759707c8cef 192.168.202.33@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:1.0:1783951247.299320:0:20772:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9e0247710000) has exports, disconnecting them 00010000:00010000:3.0:1783951247.299321:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9524 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f952b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783951247.299324:0:20772:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e02478fc000), last request at 1783951242 00010000:00010000:3.0:1783951247.299329:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951247.299332:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f96c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f96c8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783951247.299332:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f94f3 00010000:00010000:3.0:1783951247.299337:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67a00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783951247.299340:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f96c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f96c8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.299346:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f96c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f96c8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783951247.299350:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9e02478ff800 : changing import state from FULL to CLOSED 10000000:00010000:3.0:1783951247.299360:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f96c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f96c8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951247.299365:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783951247.299367:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783951247.299368:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783951247.299380:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f96c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f96c8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.299386:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1783951247.299398:0:20772:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e02478fc000): rc 0 00000020:00000080:1.0:1783951247.299400:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e02478fc000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1783951247.299404:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f96c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f96c8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783951247.299408:0:20772:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e0246682800), last request at 1783951242 00010000:00010000:3.0:1783951247.299410:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247a67a00/0x7645c8e1169f96c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f96c8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783951247.299412:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f938e 00000100:00080000:1.0:1783951247.299417:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9e0246684800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783951247.299420:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951247.299423:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f9103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f910a expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783951247.299423:0:20772:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e0246682800): rc 0 00000020:00000080:1.0:1783951247.299425:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e0246682800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1783951247.299429:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67e00 already unused, calling callback (ffffffffc1466c20) 00000020:00080000:1.0:1783951247.299429:0:20772:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e0343db1800), last request at 1783951170 00000020:00000080:1.0:1783951247.299431:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f92df 10000000:00010000:3.0:1783951247.299432:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f9103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f910a expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783951247.299434:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9e0343db6000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783951247.299439:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f9103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f910a expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783951247.299439:0:20772:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e0343db1800): rc 0 00000020:00000080:1.0:1783951247.299442:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e0343db1800/lustre-MDT0000-lwp-MDT0001_UUID 10000000:00010000:3.0:1783951247.299446:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f9103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f910a expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783951247.299446:0:20772:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e0246ae1800), last request at 1783951170 00000020:00000080:1.0:1783951247.299449:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9276 00000100:00080000:1.0:1783951247.299452:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9e037e6db000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783951247.299458:0:20772:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 10000000:01000000:3.0:1783951247.299460:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1783951247.299462:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783951247.299464:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1783951247.299477:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f9103 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f910a expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.299482:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951247.299488:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f9103 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f910a expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.299493:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247a67e00/0x7645c8e1169f9103 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f910a expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.299501:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951247.299502:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951247.299504:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783951247.299548:0:20772:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e0246ae1800): rc 0 00000004:00000080:1.0:1783951247.299555:0:20772:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb8e800c8fae0 00000100:00080000:1.0:1783951247.299577:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783951247.299580:0:20772:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1783951247.299673:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0349483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944998272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951247.299772:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951247.299826:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951247.299831:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0349480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944998144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951247.299855:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951247.299900:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944998272 00000100:00100000:3.0:1783951247.299907:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944998272 00000100:00100000:3.0:1783951247.299959:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944998144 00000100:00100000:3.0:1783951247.299962:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944998144 00000100:00100000:3.0:1783951247.299983:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783951247.299992:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0a9ba1e-8c11-4522-a460-4e640633581c+24:3655:x1870607944998272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951247.300006:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951247.300025:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247a66600/0x7645c8e1169f952b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f9524 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.300039:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951247.300073:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0a9ba1e-8c11-4522-a460-4e640633581c+23:3655:x1870607944998272:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951247.300080:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783951247.300096:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783951247.300101:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fbc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0a9ba1e-8c11-4522-a460-4e640633581c+22:3655:x1870607944998144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951247.300108:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951247.300116:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0382145000/0x7645c8e1169f9118 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f9111 expref: 22 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.300125:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951247.300188:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fbc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0a9ba1e-8c11-4522-a460-4e640633581c+21:3655:x1870607944998144:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951247.300194:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783951247.300252:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0349481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944998400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951247.300275:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951247.300297:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951247.300302:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0349482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944998528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951247.300327:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951247.300351:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944998400 00010000:00010000:0.0:1783951247.300351:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951247.300354:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944998400 00000100:00100000:3.0:1783951247.300378:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944998528 00000100:00100000:3.0:1783951247.300381:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944998528 00000100:00100000:0.0:1783951247.300394:0:18355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783951247.300409:0:18355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0a9ba1e-8c11-4522-a460-4e640633581c+22:3652:x1870607944998400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951247.300417:0:18355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951247.300427:0:18355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247b5c200/0x7645c8e1169f96c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f96c1 expref: 22 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951247.300436:0:18355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951247.300466:0:18355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0a9ba1e-8c11-4522-a460-4e640633581c+21:3652:x1870607944998400:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951247.300591:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783951247.300599:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0a9ba1e-8c11-4522-a460-4e640633581c+21:3652:x1870607944998528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951247.300614:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951247.300622:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0343609000/0x7645c8e1169f910a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f9103 expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951247.300631:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951247.300651:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0a9ba1e-8c11-4522-a460-4e640633581c+20:3652:x1870607944998528:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951247.300657:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783951247.300688:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0349482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944998528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951247.300695:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0349481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607944998400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951247.300727:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0349480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944998144:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1783951247.300730:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02478fc000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1783951247.300733:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0349483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607944998272:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1783951247.300772:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246682800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783951247.300793:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0343db1800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1783951247.300813:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e02478ff800 for lustre-MDT0000 00000020:00000080:2.0:1783951247.300817:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0246684800 for lustre-MDT0000 00000020:00000080:2.0:1783951247.300820:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0343db6000 for lustre-MDT0000 00000100:00080000:1.0:1783951247.301497:0:20772:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1783951247.301526:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9e0377950000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783951247.301573:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944998656:0@lo:39:umount.0 00000100:00100000:3.0:1783951247.301616:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951247.301648:0:18355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783951247.301710:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944998656 00000100:00100000:1.0:1783951247.301715:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944998656 00000100:00100000:1.0:1783951247.301745:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783951247.301752:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1870607944998656:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783951247.301782:0:17204:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9309 00000100:00080000:1.0:1783951247.301789:0:17204:0:(import.c:65:import_set_state_nolock()) ffff9e0246426800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783951247.301814:0:17204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:3.0:1783951247.301817:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951247.301962:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3651:x1870607944998656:12345-0@lo:39:umount.0 Request processed in 210us (345us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1783951247.301969:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1783951247.302036:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0377950000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783951247.302044:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944998656:0@lo:39:umount.0 00000100:00080000:1.0:1783951247.302465:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783951247.302468:0:20772:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1783951247.302508:0:20772:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783951247.302569:0:20772:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783951247.302583:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9e0350e6f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783951247.302604:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783951247.302606:0:20772:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1783951247.302620:0:20772:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783951247.302670:0:20772:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783951247.302677:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9e0342df7000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1783951247.302713:0:20772:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e0247710000) has no exports 00000100:00100000:3.0:1783951247.302776:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944998784:0@lo:9:umount.0 00000100:00100000:3.0:1783951247.302803:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951247.302846:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944998912:0@lo:9:umount.0 00000100:00100000:3.0:1783951247.302861:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951247.303414:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944998784 00000100:00100000:2.0:1783951247.303420:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944998784 00000100:00100000:2.0:1783951247.303471:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944998912 00000100:00080000:3.0:1783951247.303473:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951247.303475:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944998912 00000100:00100000:3.0:1783951247.303490:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783951247.303499:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1870607944998784:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783951247.303540:0:18709:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f93d4 00000100:00080000:3.0:1783951247.303563:0:18709:0:(import.c:65:import_set_state_nolock()) ffff9e0246b95800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1783951247.303583:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783951247.303594:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1870607944998912:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783951247.303609:0:18708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9532 00000001:00000004:3.0:1783951247.303610:0:18709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:2.0:1783951247.303623:0:18708:0:(import.c:65:import_set_state_nolock()) ffff9e02478fe000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783951247.303658:0:18708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1783951247.303786:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3651:x1870607944998912:12345-0@lo:9:umount.0 Request processed in 195us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951247.303793:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783951247.303820:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3651:x1870607944998784:12345-0@lo:9:umount.0 Request processed in 322us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951247.303830:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1783951247.303845:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783951247.303852:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951247.303856:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783951247.303877:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0350e6f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783951247.303903:0:3651:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783951247.303906:0:3651:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783951247.303909:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944998784:0@lo:9:umount.0 00000100:00080000:3.0:1783951247.304046:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0342df7000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783951247.304056:0:3651:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783951247.304057:0:3651:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783951247.304060:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607944998912:0@lo:9:umount.0 00000020:00080000:1.0:1783951247.314708:0:20772:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e0247710000) has no exports 00000020:00000080:1.0:1783951247.357908:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f915e 00000020:00000080:1.0:1783951247.357926:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e035079a000/lustre-QMT0000_UUID 00000020:01000000:1.0:1783951247.357952:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1783951247.357989:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e035079a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1783951247.358027:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951247.358038:0:20772:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783951247.358042:0:20772:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9e036b30cd40) has no exports 00000020:00000080:2.0:1783951247.358508:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9157 00000020:00000080:2.0:1783951247.358518:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e0377972000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783951247.358578:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377972000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783951247.358662:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951247.358672:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783951247.358675:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e0377952000/lustre-QMT0000_UUID 00000020:00000080:2.0:1783951247.358677:0:20772:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377952000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1783951247.358682:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1783951247.648329:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951247.968604:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944999168:0@lo:400:kworker.0 00000100:00100000:1.0:1783951247.968711:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951247.968769:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944999680:0@lo:400:kworker.0 00000100:00100000:1.0:1783951247.968797:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951247.968816:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607945000192:0@lo:400:kworker.0 00000100:00100000:1.0:1783951247.968843:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951247.968890:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944999680 00000100:00100000:1.0:1783951247.968899:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944999680 00000100:00100000:1.0:1783951247.968946:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945000192 00000100:00100000:1.0:1783951247.968949:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945000192 00000100:00100000:1.0:1783951247.968989:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783951247.968999:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607945000192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951247.969058:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607945000192:12345-0@lo:400:kworker.0 Request processed in 60us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951247.969066:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783951247.969086:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783951247.969090:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3655:x1870607944999680:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783951247.969096:0:19450:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783951247.969125:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3655:x1870607944999680:12345-0@lo:400:kworker.0 Request processed in 32us (326us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783951247.969166:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1783951247.969191:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951247.969218:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783951247.969223:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9e03438c8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783951247.969227:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1783951247.972587:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0a9ba1e-8c11-4522-a460-4e640633581c:3654:1870607944999040:0@lo:400:kworker.0 00000100:00100000:0.0:1783951247.972716:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951247.972814:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944999424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951247.972850:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951247.972886:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607945000064:0@lo:400:kworker.0 00000100:00100000:0.0:1783951247.972915:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951247.972983:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945000064 00000100:00100000:0.0:1783951247.972992:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945000064 00000100:00100000:0.0:1783951247.973042:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783951247.973050:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1870607945000064:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783951247.973060:0:17200:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783951247.973104:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1870607945000064:12345-0@lo:400:kworker.0 Request processed in 52us (187us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783951247.973111:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783951247.973165:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944999040 00000100:00100000:0.0:1783951247.973169:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944999040 00000100:00100000:0.0:1783951247.973201:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783951247.973207:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+19:3654:x1870607944999040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951247.973248:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b0a9ba1e-8c11-4522-a460-4e640633581c+19:3654:x1870607944999040:12345-0@lo:400:kworker.0 Request processed in 41us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951247.973254:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783951247.973313:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0a9ba1e-8c11-4522-a460-4e640633581c:3654:1870607944999040:0@lo:400:kworker.0 00000100:00080000:0.0:1783951247.973326:0:3654:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783951247.973332:0:3654:0:(import.c:65:import_set_state_nolock()) ffff9e02481c1000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783951247.973335:0:3654:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783951247.973342:0:3654:0:(import.c:65:import_set_state_nolock()) ffff9e02481c1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951247.973346:0:3654:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 557 00000100:00080000:0.0:1783951247.973361:0:3654:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e02481c1000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783951247.973394:0:3654:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0351b94a80 x1870607945000448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951247.973419:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607945000064:0@lo:400:kworker.0 00000100:00100000:0.0:1783951247.973477:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944999168 00000100:00100000:0.0:1783951247.973481:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944999168 00000100:00100000:0.0:1783951247.973506:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783951247.973511:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3655:x1870607944999168:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783951247.973517:0:17940:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783951247.973546:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3655:x1870607944999168:12345-0@lo:400:kworker.0 Request processed in 33us (4836us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783951247.973552:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783951247.973572:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944999552:0@lo:400:kworker.0 00000100:00100000:0.0:1783951247.973600:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951247.973629:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944999936:0@lo:400:kworker.0 00000100:00100000:0.0:1783951247.973652:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951247.973674:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783951247.973682:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944999296:0@lo:400:kworker.0 00000100:00100000:0.0:1783951247.973703:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951247.973720:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944999808:0@lo:400:kworker.0 00000100:00100000:0.0:1783951247.973739:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951247.973755:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945000320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951247.973775:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951247.973801:0:19194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944999552 00000100:00100000:0.0:1783951247.973804:0:19194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944999552 00000100:00100000:0.0:1783951247.973848:0:19194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944999296 00000100:00100000:0.0:1783951247.973851:0:19194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944999296 00000100:00100000:0.0:1783951247.973871:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783951247.973877:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944999552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951247.973917:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944999552:12345-0@lo:400:kworker.0 Request processed in 40us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951247.973924:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783951247.973936:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783951247.973942:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944999296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951247.973969:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607944999296:12345-0@lo:400:kworker.0 Request processed in 28us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951247.973975:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783951247.973992:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945000320 00000100:00100000:0.0:1783951247.973996:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945000320 00000100:00100000:0.0:1783951247.974013:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783951247.974017:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3653:x1870607945000320:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1783951247.974021:0:17204:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783951247.974046:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3653:x1870607945000320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 28us (270us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783951247.974052:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783951247.974073:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944999936 00000100:00100000:0.0:1783951247.974076:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944999936 00000100:00100000:0.0:1783951247.974102:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944999808 00000100:00100000:0.0:1783951247.974105:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944999808 00000100:00100000:0.0:1783951247.974118:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783951247.974125:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944999936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951247.974189:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607944999936:12345-0@lo:400:kworker.0 Request processed in 65us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951247.974205:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783951247.974218:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783951247.974222:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3653:x1870607944999808:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783951247.974227:0:17201:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783951247.974250:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3653:x1870607944999808:12345-0@lo:400:kworker.0 Request processed in 27us (510us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783951247.974256:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1783951247.974278:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783951247.974283:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951247.974318:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944999296:0@lo:400:kworker.0 00000100:00080000:0.0:1783951247.974328:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783951247.974332:0:3653:0:(import.c:65:import_set_state_nolock()) ffff9e0246bcb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783951247.974336:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783951247.974340:0:3653:0:(import.c:65:import_set_state_nolock()) ffff9e0246bcb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951247.974344:0:3653:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 541 00000100:00080000:0.0:1783951247.974349:0:3653:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e0246bcb800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783951247.974369:0:3653:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0351b97100 x1870607945000576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951247.974382:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607944999808:0@lo:400:kworker.0 00000100:02020000:0.0:1783951247.974392:0:3653:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:2.0:1783951247.976207:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607944999424 00000100:00100000:2.0:1783951247.976223:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607944999424 00000100:00100000:2.0:1783951247.976321:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783951247.976333:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944999424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783951247.976375:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1783951247.976571:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607944999424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 239us (3718us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951247.976580:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783951247.976722:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607944999424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951247.976797:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1870607945000448:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783951247.976887:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951247.976911:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1870607945000576:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783951247.976990:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951247.977036:0:20539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945000448 00000100:00100000:2.0:1783951247.977039:0:20539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945000448 00000100:00100000:2.0:1783951247.977059:0:20539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945000576 00000100:00100000:2.0:1783951247.977061:0:20539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945000576 00000100:00100000:2.0:1783951247.977075:0:20539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783951247.977079:0:20539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3651:x1870607945000448:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1783951247.977093:0:20539:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1783951247.977182:0:20539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3651:x1870607945000448:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 100us (293us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951247.977188:0:20539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783951247.977201:0:20539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783951247.977205:0:20539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3651:x1870607945000576:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1783951247.977212:0:20539:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1783951247.977237:0:20539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3651:x1870607945000576:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 31us (292us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951247.977242:0:20539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1783951247.977267:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e02481c1000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951247.977273:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951247.977276:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1870607945000448:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1783951247.977284:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246bcb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951247.977287:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951247.977289:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1870607945000576:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1783951247.980372:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9e03438c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951247.980385:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 526 00000100:00080000:1.0:1783951247.980397:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e03438c8000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951247.980477:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037d247100 x1870607945000704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951247.980515:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607944999680:0@lo:400:kworker.0 00000100:00100000:2.0:1783951247.980553:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1870607945000704:0@lo:38:ptlrpcd_00_03.0 00010000:00080000:1.0:1783951247.980558:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0342e80a80 x1870607945000192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951247.980571:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607945000192:0@lo:400:kworker.0 00000100:00080000:1.0:1783951247.980607:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783951247.980611:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9e0246ae6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783951247.980614:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783951247.980620:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9e0246ae6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951247.980624:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 526 00000100:00080000:1.0:1783951247.980627:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e0246ae6800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783951247.980636:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951247.980758:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037d246300 x1870607945000832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951247.980778:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607944999168:0@lo:400:kworker.0 00000100:00100000:2.0:1783951247.980845:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945000832:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1783951247.980885:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951247.981016:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945000832 00000100:00100000:1.0:1783951247.981024:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945000832 00000100:00100000:3.0:1783951247.981033:0:19450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945000704 00000100:00100000:3.0:1783951247.981040:0:19450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945000704 00000100:00100000:1.0:1783951247.981072:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783951247.981081:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1870607945000832:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1783951247.981101:0:17204:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783951247.981177:0:19450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783951247.981185:0:19450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024856a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1870607945000704:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1783951247.981193:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1870607945000832:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 109us (305us total) trans 0 rc -19/-19 00010000:02000000:3.0:1783951247.981197:0:19450:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783951247.981205:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1783951247.981893:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246ae6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951247.981900:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951247.981902:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945000832:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1783951247.987283:0:19450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024856a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1870607945000704:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 6081us (6629us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951247.987306:0:19450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1783951247.990408:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e03438c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951247.990427:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951247.990434:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1870607945000704:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1783951248.000211:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783951248.000222:0:3653:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9e0246ae6800 already not connected (conn 2, was 1): DISCONN 00000100:00100000:0.0:1783951248.000295:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607944999552:0@lo:400:kworker.0 00010000:00080000:0.0:1783951248.000347:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0342e81180 x1870607944999936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951248.000358:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607944999936:0@lo:400:kworker.0 00010000:00010000:3.0:1783951248.672667:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783951249.506166:0:19522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783951249.506180:0:19522:0:(genops.c:906:class_export_put()) final put ffff9e02478fe800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783951249.506205:0:19522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e04e128-5618-477b-951f-a759707c8cef 00000020:00000080:2.0:1783951249.506208:0:19522:0:(genops.c:906:class_export_put()) final put ffff9e02478fd800/6e04e128-5618-477b-951f-a759707c8cef 00000020:00000080:3.0:1783951249.506317:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02478fe800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1783951249.506456:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02478fd800/6e04e128-5618-477b-951f-a759707c8cef for lustre-OST0001 00000020:00000080:3.0:1783951249.506480:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e02478fe000 for lustre-OST0001 00000020:00000080:3.0:1783951249.506485:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e02478fc800 for lustre-OST0001 00000001:00100000:1.0:1783951249.516901:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783951249.516917:0:17179:0:(genops.c:906:class_export_put()) final put ffff9e0246ae1800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1783951249.516951:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a956fd71-c100-46a9-957b-d126f21246ff 00000001:00080000:1.0:1783951249.516969:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:1.0:1783951249.516974:0:17179:0:(genops.c:906:class_export_put()) final put ffff9e02478f9000/a956fd71-c100-46a9-957b-d126f21246ff 00000001:00100000:1.0:1783951249.516980:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e04e128-5618-477b-951f-a759707c8cef 00000001:00080000:1.0:1783951249.516988:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00000080:1.0:1783951249.516992:0:17179:0:(genops.c:906:class_export_put()) final put ffff9e02481c5000/6e04e128-5618-477b-951f-a759707c8cef 00000020:00000080:2.0:1783951249.517589:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246ae1800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1783951249.517675:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02478f9000/a956fd71-c100-46a9-957b-d126f21246ff for lustre-MDT0000 00000020:00000080:2.0:1783951249.517717:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02481c5000/6e04e128-5618-477b-951f-a759707c8cef for lustre-MDT0000 00000020:00000080:2.0:1783951249.517749:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e037e6db000 for lustre-MDT0000 00000020:00000080:2.0:1783951249.517754:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e02478fb800 for lustre-MDT0000 00000020:00000080:2.0:1783951249.517758:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e02481c4800 for lustre-MDT0000 00000001:00100000:0.0:1783951249.518478:0:17932:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783951249.518491:0:17932:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1783951249.518497:0:17932:0:(genops.c:906:class_export_put()) final put ffff9e0246ae3800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1783951249.518557:0:17932:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a956fd71-c100-46a9-957b-d126f21246ff 00000001:00080000:0.0:1783951249.518563:0:17932:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1783951249.518566:0:17932:0:(genops.c:906:class_export_put()) final put ffff9e02478f8800/a956fd71-c100-46a9-957b-d126f21246ff 00000020:00000080:3.0:1783951249.518631:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246ae3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1783951249.518693:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0246426800 for lustre-MDT0001 00000001:00100000:0.0:1783951249.518740:0:17932:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6e04e128-5618-477b-951f-a759707c8cef 00000001:00080000:0.0:1783951249.518745:0:17932:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1783951249.518748:0:17932:0:(genops.c:906:class_export_put()) final put ffff9e02481c2000/6e04e128-5618-477b-951f-a759707c8cef 00000020:00000080:2.0:1783951249.518802:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02478f8800/a956fd71-c100-46a9-957b-d126f21246ff for lustre-MDT0001 00000020:00000080:2.0:1783951249.518836:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02481c2000/6e04e128-5618-477b-951f-a759707c8cef for lustre-MDT0001 00000020:00000080:2.0:1783951249.518858:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e036c57d800 for lustre-MDT0001 00000020:00000080:2.0:1783951249.518862:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e02481c3800 for lustre-MDT0001 00010000:00010000:3.0:1783951249.696416:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951250.720465:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951251.552837:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945000960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783951251.552946:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951251.553053:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945000960 00000100:00100000:2.0:1783951251.553064:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945000960 00000100:00100000:2.0:1783951251.553282:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1783951251.553289:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951251.553299:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945000960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951251.553345:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783951251.553878:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945000960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 532us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951251.553889:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783951251.554028:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945000960:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783951251.744711:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951252.771937:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783951252.833036:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1783951253.088761:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783951253.088770:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1783951253.088771:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951253.088777:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e0246ae6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951253.088798:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 603 00000100:00100000:1.0:1783951253.088801:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607945001088:0@lo:400:kworker.0 00000100:00080000:2.0:1783951253.088807:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783951253.088818:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e0246ae6800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783951253.088852:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e02483a2300 x1870607945001216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951253.088899:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951253.088914:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1783951253.088915:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951253.088922:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951253.088925:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e03438c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783951253.088931:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945001344:0@lo:400:kworker.0 00000100:00080000:2.0:1783951253.088932:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 603 00000100:00080000:2.0:1783951253.088936:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783951253.088944:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e03438c8000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783951253.088963:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0381129f80 x1870607945001600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951253.088975:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951253.088979:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1783951253.088981:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945001216:0@lo:38:kworker.0 00000100:00080000:2.0:1783951253.088984:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e0246bcb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783951253.088985:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783951253.088993:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 603 00000100:00080000:2.0:1783951253.088997:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783951253.089002:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e0246bcb800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783951253.089018:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e03489c6300 x1870607945001728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951253.089029:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951253.089037:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945001472:0@lo:400:kworker.0 00000100:00080000:2.0:1783951253.089042:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951253.089047:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951253.089049:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e02481c1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1783951253.089057:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1870607945001600:0@lo:38:kworker.0 00000100:00080000:2.0:1783951253.089063:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 603 00000100:00080000:2.0:1783951253.089067:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783951253.089073:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e02481c1000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951253.089076:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951253.089102:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0248609f80 x1870607945001984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783951253.089114:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951253.089114:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951253.089125:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607945001856:0@lo:400:kworker.0 00000100:00100000:1.0:1783951253.089170:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1870607945001728:0@lo:38:kworker.0 00000100:00100000:3.0:1783951253.089178:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951253.089207:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951253.089230:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1870607945001984:0@lo:38:kworker.0 00000100:00100000:0.0:1783951253.089345:0:19194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945001344 00000100:00100000:0.0:1783951253.089353:0:19194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945001344 00000100:00100000:0.0:1783951253.089432:0:19194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945001472 00000100:00100000:0.0:1783951253.089436:0:19194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945001472 00000100:00100000:0.0:1783951253.089464:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783951253.089475:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945001344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951253.089501:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951253.089545:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945001344:12345-0@lo:400:kworker.0 Request processed in 71us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951253.089554:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783951253.089573:0:19194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783951253.089586:0:19194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945001472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951253.089637:0:19194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945001472:12345-0@lo:400:kworker.0 Request processed in 52us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951253.089644:0:19194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783951253.089818:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0351b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945002240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951253.089855:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951253.089915:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951253.089921:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607945002112:0@lo:400:kworker.0 00000100:00100000:2.0:1783951253.091355:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945001088 00000100:00100000:2.0:1783951253.091369:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945001088 00000001:00100000:0.0:1783951253.092007:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783951253.092014:0:18703:0:(genops.c:906:class_export_put()) final put ffff9e0246b93000/lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1783951253.092136:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945002240 00000100:00100000:2.0:1783951253.092488:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783951253.092513:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+19:3655:x1870607945001088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951253.092609:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b0a9ba1e-8c11-4522-a460-4e640633581c+19:3655:x1870607945001088:12345-0@lo:400:kworker.0 Request processed in 110us (3710us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951253.092618:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783951253.092662:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945001216 00000100:00100000:2.0:1783951253.092668:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945001216 00000100:00100000:2.0:1783951253.092692:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783951253.092698:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1870607945001216:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1783951253.092717:0:17205:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783951253.092795:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945001600 00000100:00100000:3.0:1783951253.092801:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945001600 00000100:00100000:3.0:1783951253.092831:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945001856 00000100:00100000:3.0:1783951253.092834:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945001856 00000100:00100000:3.0:1783951253.092859:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945001728 00000100:00100000:3.0:1783951253.092862:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945001728 00000100:00100000:3.0:1783951253.092870:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945001984 00000100:00100000:3.0:1783951253.092873:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945001984 00000100:00100000:3.0:1783951253.092882:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783951253.092890:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607945001856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951253.092933:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607945001856:12345-0@lo:400:kworker.0 Request processed in 44us (3757us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951253.092959:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783951253.092979:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783951253.092984:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1870607945001600:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783951253.092993:0:17199:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783951253.093032:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1870607945001600:12345-0@lo:38:kworker.0 Request processed in 47us (3920us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951253.093038:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783951253.093049:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783951253.093053:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1870607945001728:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1783951253.093060:0:17199:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783951253.093096:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1870607945001728:12345-0@lo:38:kworker.0 Request processed in 41us (3890us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951253.093165:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783951253.093174:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1870607945001984:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1783951253.093183:0:17201:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783951253.093219:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1870607945001984:12345-0@lo:38:kworker.0 Request processed in 45us (3718us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951253.093226:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783951253.093247:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951253.093278:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783951253.093292:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945002112 00000100:00100000:3.0:1783951253.093296:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945002112 00000100:00100000:1.0:1783951253.093303:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b0a9ba1e-8c11-4522-a460-4e640633581c:3655:1870607945001088:0@lo:400:kworker.0 00000100:00100000:3.0:1783951253.093317:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783951253.093324:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607945002112:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783951253.093355:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246bcb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951253.093361:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951253.093365:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1870607945001728:0@lo:38:kworker.0 00000100:00080000:1.0:1783951253.093375:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e02481c1000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951253.093379:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951253.093381:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1870607945001984:0@lo:38:kworker.0 00000100:00080000:1.0:1783951253.093393:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e03438c8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951253.093396:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951253.093399:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1870607945001600:0@lo:38:kworker.0 00000100:00100000:3.0:1783951253.093464:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607945002112:12345-0@lo:400:kworker.0 Request processed in 140us (215us total) trans 0 rc 0/0 00000100:00080000:1.0:1783951253.093466:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951253.093474:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951253.093476:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1783951253.093479:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783951253.093548:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024860ad80 x1870607945001856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951253.093565:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607945001856:0@lo:400:kworker.0 00000100:00100000:1.0:1783951253.093566:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945001344:0@lo:400:kworker.0 00000100:00100000:3.0:1783951253.093588:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945001472:0@lo:400:kworker.0 00010000:00080000:3.0:1783951253.093624:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e024860bb80 x1870607945002112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951253.093641:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607945002112:0@lo:400:kworker.0 00000020:00000080:3.0:1783951253.093669:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246b93000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1783951253.093738:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0246b95800 for lustre-OST0000 00000100:00100000:0.0:1783951253.097161:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945002240 00000100:00100000:0.0:1783951253.097280:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783951253.097294:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607945002240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951253.097373:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1783951253.097487:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607945002240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 196us (7630us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951253.097496:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783951253.102722:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0351b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945002240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951253.114799:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1870607945001216:12345-0@lo:38:kworker.0 Request processed in 22092us (25764us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951253.114815:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1783951253.114921:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246ae6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951253.114934:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951253.114940:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945001216:0@lo:38:kworker.0 00000020:01000000:1.0:1783951253.408297:0:20772:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e0247bad6c0 - data ffff9e0351464870/ffff9e024658c800 00000020:01000000:1.0:1783951253.408475:0:20772:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e037e57b540 - data ffff9e0372486e58/ffff9e03477f2800 00000001:00000004:1.0:1783951253.415130:0:20772:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00080000:0.0:1783951253.448450:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783951253.448462:0:20772:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783951253.448483:0:20772:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e037d244e00 x1870607944998656/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783951257 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951253.448514:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1783951253.450433:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783951253.450443:0:20772:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1783951253.450467:0:20772:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783951253.450499:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783951253.450871:0:17223:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783951253.450877:0:17223:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1783951253.450892:0:17223:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1783951253.451653:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783951253.451659:0:20772:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1783951253.451679:0:20772:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783951253.451681:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783951253.452931:0:17225:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783951253.452939:0:17225:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:2.0:1783951253.452954:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1783951253.454223:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9126 00000020:00000080:0.0:1783951253.454239:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e035079d800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783951253.454292:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e035079d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783951253.455582:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f913b 00000020:00000080:0.0:1783951253.455597:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e0377955800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783951253.455607:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1783951253.455613:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951253.455625:0:20772:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783951253.455630:0:20772:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9e0247713380) has no exports 00000020:00000080:3.0:1783951253.455632:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377955800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1783951253.455862:0:20772:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1783951253.455872:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f919d 00000020:00000080:0.0:1783951253.455877:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e0342df5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783951253.455891:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783951253.455894:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951253.455899:0:20772:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783951253.455901:0:20772:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9e037d0acd40) has no exports 00000020:00000080:0.0:1783951253.455908:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9196 00000020:00000080:0.0:1783951253.455912:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e0342df0800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783951253.456030:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0342df5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783951253.456037:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0342df0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783951253.456262:0:20772:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783951253.456267:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783951253.456271:0:20772:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1783951253.456278:0:20772:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783951253.456280:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783951253.456538:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0342df7000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783951253.456607:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951253.456614:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783951253.456618:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e0377976800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783951253.456621:0:20772:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377976800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1783951253.456626:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783951253.456726:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9188 00000020:00000080:0.0:1783951253.456731:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e0377970800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783951253.456743:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783951253.456746:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951253.456749:0:20772:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783951253.456752:0:20772:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9e036b30b380) has no exports 00000020:00000080:0.0:1783951253.456756:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9181 00000020:00000080:0.0:1783951253.456759:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e03779c5000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783951253.456861:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377970800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783951253.456874:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03779c5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783951253.457049:0:20772:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783951253.457052:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783951253.457055:0:20772:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1783951253.457058:0:20772:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783951253.457059:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783951253.457132:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0350e6f000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1783951253.457768:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951253.457774:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783951253.457779:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e0377971800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783951253.457781:0:20772:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377971800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1783951253.457786:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1783951253.457844:0:20772:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1783951253.457850:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9173 00000020:00000080:0.0:1783951253.457855:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e0377974800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783951253.457866:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1783951253.457870:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951253.457873:0:20772:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783951253.457876:0:20772:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9e036b308000) has no exports 00000020:00000080:0.0:1783951253.457881:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f916c 00000020:00000080:0.0:1783951253.457884:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e035079d000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783951253.457896:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377974800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1783951253.457907:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e035079d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783951253.461340:0:20772:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1783951253.461352:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783951253.461369:0:20772:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783951253.461378:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783951253.461433:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0377950000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1783951253.461452:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951253.461472:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951253.461479:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e0377973800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783951253.461484:0:20772:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377973800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1783951253.461492:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951253.461642:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951253.461646:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951253.461649:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e035079e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783951253.461651:0:20772:0:(genops.c:865:class_export_destroy()) destroying export ffff9e035079e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1783951253.461655:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951253.461706:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9142 00000020:00000080:2.0:1783951253.461713:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e0377952800/lustre-MDD0000_UUID 00000020:01000000:2.0:1783951253.461723:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1783951253.461726:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951253.461731:0:20772:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783951253.461736:0:20772:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9e02477119c0) has no exports 00000020:00000080:3.0:1783951253.461741:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377952800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1783951253.461760:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951253.461763:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1783951253.461766:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e035079c000/lustre-MDD0000_UUID 00000020:00000080:2.0:1783951253.461768:0:20772:0:(genops.c:865:class_export_destroy()) destroying export ffff9e035079c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1783951253.461772:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1783951253.461796:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9149 00000020:00000080:2.0:1783951253.461800:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e0377954800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783951253.461816:0:20772:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0248309800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1783951253.461820:0:20772:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0248309800 3 00000020:01000004:2.0:1783951253.461823:0:20772:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e0248309800 from lustre-MDT0000 00000020:00000080:3.0:1783951253.461840:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0377954800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783951253.461844:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951253.461849:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1783951253.461852:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e035079a800/lustre-MDT0000_UUID 00000020:00000080:2.0:1783951253.461861:0:20772:0:(genops.c:865:class_export_destroy()) destroying export ffff9e035079a800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1783951253.461869:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1783951253.461895:0:20772:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1783951253.461898:0:20772:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1783951253.461901:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1783951253.461903:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951253.461906:0:20772:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783951253.461913:0:20772:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9e02482ed800 b0a9ba1e-8c11-4522-a460-4e640633581c 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951253.461918:0:20772:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9e037d0a8000) has exports, disconnecting them 00000020:00080000:2.0:1783951253.461923:0:20772:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e02482ed800), last request at 1783951156 00000020:00000080:2.0:1783951253.461941:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f90ee 00000020:00010000:2.0:1783951253.461944:0:20772:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e02482ed800: total 0 00000100:00080000:2.0:1783951253.461949:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9e02482ef800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783951253.461964:0:20772:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e02482ed800): rc 0 00000020:00080000:2.0:1783951253.461968:0:20772:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9e037d0a8000) has no exports 00000100:00100000:2.0:1783951253.462030:0:17193:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e03461ae200:17193] 1 exiting: rc = 0 00000100:00100000:2.0:1783951253.462188:0:17192:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e0352a7aa00:17192] 0 exiting: rc = 1 00000020:00010000:3.0:1783951253.462234:0:17188:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e02482ed800: total 0 00010000:00010000:3.0:1783951253.462292:0:17188:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e02482ed800, canceled 0 locks, left on hash table 13. 00000100:00100000:2.0:1783951253.462294:0:17194:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e0377b72000:17194] 2 exiting: rc = 0 00000100:00100000:2.0:1783951253.462353:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462361:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462366:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462372:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462378:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462384:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462390:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462395:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462400:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462406:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462412:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462417:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462422:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462427:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462439:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462445:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462451:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462457:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462462:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462468:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462473:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462479:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462483:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462488:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462493:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462497:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462502:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462507:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462512:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462517:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462522:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462527:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1783951253.462531:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247b5dc00/0x7645c8e1169f96ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f96b3 expref: 14 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951253.462536:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462547:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462553:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462560:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1783951253.462565:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f94de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f94d7 expref: 13 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951253.462569:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462578:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462582:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462592:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462602:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1783951253.462613:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247a67800/0x7645c8e1169f951d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f9516 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951253.462613:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462625:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462632:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1783951253.462641:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247b5cc00/0x7645c8e1169f96ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f96a5 expref: 11 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951253.462641:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462652:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462662:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1783951253.462665:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0343608e00/0x7645c8e1169f934f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f9348 expref: 10 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951253.462673:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462681:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1783951253.462687:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247b5d400/0x7645c8e1169f920d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f9206 expref: 9 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951253.462695:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462702:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462712:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1783951253.462718:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0343609a00/0x7645c8e1169f92ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f92c3 expref: 8 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951253.462721:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462731:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462741:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1783951253.462742:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247b5d600/0x7645c8e1169f94b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f94ad expref: 7 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951253.462751:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1783951253.462764:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0382145800/0x7645c8e1169f921b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f9214 expref: 6 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951253.462764:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462773:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462783:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1783951253.462790:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0382145200/0x7645c8e1169f9229 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f9222 expref: 5 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951253.462791:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462802:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462813:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1783951253.462814:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0382145a00/0x7645c8e1169f90fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f90f5 expref: 4 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951253.462820:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951253.462825:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1783951253.462844:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0343608800/0x7645c8e1169f9379 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f9372 expref: 3 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951253.462877:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247b5de00/0x7645c8e1169f969e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7645c8e1169f9697 expref: 2 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951253.462891:0:17188:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e02482ed800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1783951253.462920:0:17188:0:(genops.c:906:class_export_put()) final put ffff9e02482ed800/b0a9ba1e-8c11-4522-a460-4e640633581c 00010000:00010000:3.0:1783951253.462937:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951253.462940:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951253.462943:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783951253.462952:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02482ed800/b0a9ba1e-8c11-4522-a460-4e640633581c for MGS 00000020:00000080:3.0:1783951253.462989:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e02482ef800 for MGS 00000020:01000000:2.0:1783951253.466484:0:20772:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e0247badd80 - data ffff9e0351464510/ffff9e024658e400 00000020:01000000:2.0:1783951253.466672:0:20772:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e03454a97e0 - data ffff9e03726e7a20/ffff9e037ebd0800 00000020:00000080:2.0:1783951253.467618:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f90d2 00000020:00000080:2.0:1783951253.467631:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e0248308000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783951253.467650:0:20772:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0248309800 from MGS, refs=2 00000020:01000004:2.0:1783951253.467654:0:20772:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0248309800 2 00000020:01000004:2.0:1783951253.467657:0:20772:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e0248309800 from MGS 00000020:00000080:2.0:1783951253.467692:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951253.467700:0:20772:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1783951253.467702:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e024830e000/MGS 00000020:00000080:2.0:1783951253.467706:0:20772:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024830e000/MGS for MGS 00000020:01000000:2.0:1783951253.467714:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:3.0:1783951253.467796:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0248308000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783951253.467967:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1783951253.467972:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951253.467978:0:20772:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783951253.467986:0:20772:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e037e5dd800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951253.467992:0:20772:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9e036b3099c0) has exports, disconnecting them 00000020:00080000:2.0:1783951253.467997:0:20772:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e037e5dd800), last request at 1783951156 00000020:00000080:2.0:1783951253.468011:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f91d5 00000020:00080000:2.0:1783951253.468021:0:20772:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e037e5dd800): rc 0 00000020:00000080:2.0:1783951253.468026:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e037e5dd800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783951253.468324:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e037e5dd800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1783951253.469403:0:20772:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1783951253.469410:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783951253.469415:0:20772:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783951253.469422:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783951253.469443:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e037e5d9800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783951253.469585:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951253.469593:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1783951253.469597:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e0350e68000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1783951253.469600:0:20772:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0350e68000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1783951253.469604:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1783951253.469685:0:20772:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0248309800 1 00000020:00000080:3.0:1783951253.469689:0:20772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f90c4 00000020:00000080:3.0:1783951253.469694:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e024830e800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1783951253.469701:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1783951253.469707:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024830e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783951253.469714:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951253.469724:0:20772:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783951253.469727:0:20772:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9e037d0a99c0) has no exports 00000020:00000080:1.0:1783951253.511476:0:20772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951253.511492:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1783951253.511499:0:20772:0:(genops.c:906:class_export_put()) final put ffff9e024830f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783951253.511504:0:20772:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024830f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783951253.511517:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1783951253.511665:0:20772:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e024830b800 00000020:02000400:1.0:1783951253.511730:0:20772:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1783951253.792916:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951254.818713:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951255.844426:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951256.672947:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945002368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951256.673066:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951256.673122:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945002368 00000100:00100000:1.0:1783951256.673166:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945002368 00000100:00080000:2.0:1783951256.673214:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951256.673283:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783951256.673293:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945002368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783951256.673342:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783951256.673397:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945002368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951256.673405:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783951256.673437:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945002368:0@lo:13:osp-pre-0-1.0 00000020:01000004:2.0:1783951256.787845:0:20973:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783951256.805520:0:20973:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1783951256.805587:0:20973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5ce00/0x7645c8e1169f92c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f92ca expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.805604:0:20973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5ce00/0x7645c8e1169f92c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f92ca expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.805612:0:20973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5ce00/0x7645c8e1169f92c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f92ca expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.805619:0:20973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0247b5ce00/0x7645c8e1169f92c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f92ca expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.805639:0:20973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783951256.805645:0:20973:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783951256.805670:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783951256.805675:0:20973:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783951256.805681:0:20973:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783951256.805687:0:20973:0:(import.c:65:import_set_state_nolock()) ffff9e03438c8000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1783951256.805703:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783951256.805705:0:20973:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783951256.805709:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783951256.807213:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951256.807225:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247b5ce00/0x7645c8e1169f92c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f92ca expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951256.807237:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5ce00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783951256.807242:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247b5ce00/0x7645c8e1169f92c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f92ca expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951256.807253:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247b5ce00/0x7645c8e1169f92c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f92ca expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951256.807262:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247b5ce00/0x7645c8e1169f92c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f92ca expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951256.807269:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783951256.807272:0:17188:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783951256.807275:0:17188:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783951256.807317:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247b5ce00/0x7645c8e1169f92c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f92ca expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951256.807323:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783951256.807406:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1783951256.808032:0:20973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343609c00/0x7645c8e1169f9222 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9229 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.808044:0:20973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343609c00/0x7645c8e1169f9222 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9229 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.808062:0:20973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343609c00/0x7645c8e1169f9222 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f9229 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.808070:0:20973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0343609c00/0x7645c8e1169f9222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f9229 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.808136:0:20973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951256.808161:0:20973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340030a00/0x7645c8e1169f9516 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f951d expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.808169:0:20973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340030a00/0x7645c8e1169f9516 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f951d expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.808176:0:20973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340030a00/0x7645c8e1169f9516 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f951d expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.808183:0:20973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0340030a00/0x7645c8e1169f9516 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f951d expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951256.808237:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247b5ce00/0x7645c8e1169f92c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f92ca expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951256.808246:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247b5ce00/0x7645c8e1169f92c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f92ca expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951256.808260:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951256.808263:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0343609c00/0x7645c8e1169f9222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f9229 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951256.808282:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783951256.808285:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0343609c00/0x7645c8e1169f9222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f9229 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951256.808292:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0343609c00/0x7645c8e1169f9222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f9229 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951256.808297:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0343609c00/0x7645c8e1169f9222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f9229 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951256.808302:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783951256.808304:0:17188:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1783951256.808322:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0343609c00/0x7645c8e1169f9222 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f9229 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951256.808328:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951256.808348:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0343609c00/0x7645c8e1169f9222 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f9229 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951256.808354:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0343609c00/0x7645c8e1169f9222 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f9229 expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951256.808363:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951256.808365:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0340030a00/0x7645c8e1169f9516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f951d expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951256.808370:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030a00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783951256.808372:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0340030a00/0x7645c8e1169f9516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f951d expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951256.808389:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0340030a00/0x7645c8e1169f9516 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f951d expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951256.808394:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0340030a00/0x7645c8e1169f9516 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f951d expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951256.808398:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1783951256.808400:0:17188:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1783951256.808411:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0340030a00/0x7645c8e1169f9516 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f951d expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951256.808416:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951256.808421:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0340030a00/0x7645c8e1169f9516 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f951d expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951256.808428:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951256.808430:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951256.812235:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951256.812364:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607945002496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951256.812437:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951256.812567:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945002496 00000100:00100000:1.0:1783951256.812575:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945002496 00000100:00100000:1.0:1783951256.812627:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783951256.812635:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3652:x1870607945002496:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783951256.812642:0:17184:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783951256 with bad export cookie 8522438738941284590 00000100:00100000:0.0:1783951256.816213:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0a9ba1e-8c11-4522-a460-4e640633581c:3654:1870607945002624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951256.816308:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951256.816365:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951256.816372:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0a9ba1e-8c11-4522-a460-4e640633581c:3654:1870607945002752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951256.816394:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951256.816433:0:18355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945002624 00000100:00100000:0.0:1783951256.816440:0:18355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945002624 00000100:00100000:0.0:1783951256.816471:0:18355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945002752 00000100:00100000:0.0:1783951256.816474:0:18355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945002752 00000100:00100000:0.0:1783951256.816486:0:18355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783951256.816493:0:18355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0351b97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3654:x1870607945002624:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783951256.816500:0:18355:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783951256 with bad export cookie 8522438738941284590 00000100:00100000:0.0:1783951256.816546:0:18355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3654:x1870607945002624:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (238us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783951256.816554:0:18355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783951256.816570:0:18355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783951256.816575:0:18355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e425880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3654:x1870607945002752:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783951256.816579:0:18355:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783951256 with bad export cookie 8522438738941284590 00000100:00100000:0.0:1783951256.816601:0:18355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e425880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3654:x1870607945002752:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (207us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783951256.816607:0:18355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1783951256.816635:0:3654:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.133@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783951256.816640:0:3654:0:(import.c:65:import_set_state_nolock()) ffff9e02482ef000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1783951256.816644:0:3654:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.133@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1783951256.816725:0:20973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783951256.816737:0:20973:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0340030a00/0x7645c8e1169f9516 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f951d expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951256.816766:0:20973:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1783951256.816778:0:20973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67000/0x7645c8e1169f96b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f96ba expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.816787:0:20973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67000/0x7645c8e1169f96b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f96ba expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.816795:0:20973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a67000/0x7645c8e1169f96b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f96ba expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.816802:0:20973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0247a67000/0x7645c8e1169f96b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f96ba expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.816813:0:20973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951256.816818:0:20973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343609400/0x7645c8e1169f9214 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f921b expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.816826:0:20973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343609400/0x7645c8e1169f9214 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f921b expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.816832:0:20973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343609400/0x7645c8e1169f9214 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f921b expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.816839:0:20973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0343609400/0x7645c8e1169f9214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f921b expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.816846:0:20973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1783951256.816849:0:20973:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1783951256.816852:0:20973:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1783951256.816894:0:20973:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1783951256.816899:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1783951256.816904:0:20973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951256.816910:0:20973:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1783951256.816916:0:20973:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9e024762f800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951256.816923:0:20973:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9e0246685800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951256.816928:0:20973:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9e0246b43380) has exports, disconnecting them 00000020:00080000:2.0:1783951256.816933:0:20973:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9e024762f800), last request at 1783951253 00000020:00000080:2.0:1783951256.816940:0:20973:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9508 00000100:00080000:2.0:1783951256.816957:0:20973:0:(import.c:65:import_set_state_nolock()) ffff9e0247629800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783951256.816999:0:20973:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e024762f800): rc 0 00000020:00000080:2.0:1783951256.817002:0:20973:0:(genops.c:906:class_export_put()) final put ffff9e024762f800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1783951256.817014:0:20973:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9e0246685800), last request at 1783951253 00000020:00000080:2.0:1783951256.817017:0:20973:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f93a3 00000100:00080000:2.0:1783951256.817022:0:20973:0:(import.c:65:import_set_state_nolock()) ffff9e0246680000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783951256.817029:0:20973:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e0246685800): rc 0 00000020:00000080:2.0:1783951256.817031:0:20973:0:(genops.c:906:class_export_put()) final put ffff9e0246685800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1783951256.817038:0:20973:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb8e801dabae0 00000100:00080000:2.0:1783951256.817069:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783951256.817077:0:20973:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9e037d245c00 x1870607945000320/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783951263 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951256.817092:0:20973:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783951256.817922:0:20973:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783951256.817929:0:20973:0:(import.c:65:import_set_state_nolock()) ffff9e0246ae6800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1783951256.822482:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951256.822498:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247a67000/0x7645c8e1169f96b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f96ba expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951256.822511:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783951256.822515:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a67000/0x7645c8e1169f96b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f96ba expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951256.822526:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247a67000/0x7645c8e1169f96b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f96ba expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951256.822534:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a67000/0x7645c8e1169f96b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f96ba expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951256.822559:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783951256.822562:0:17188:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783951256.822567:0:17188:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:2.0:1783951256.822851:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783951256.822857:0:20973:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1783951256.822879:0:20973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1783951256.822938:0:20973:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1783951256.822969:0:20973:0:(import.c:65:import_set_state_nolock()) ffff9e037e6de000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1783951256.822988:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783951256.822990:0:20973:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1783951256.823001:0:20973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1783951256.823066:0:20973:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1783951256.823078:0:20973:0:(import.c:65:import_set_state_nolock()) ffff9e0380fb7000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1783951256.823129:0:20973:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9e0246b43380) has no exports 00010000:00010000:1.0:1783951256.824829:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00000080:1.0:1783951256.824864:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024762f800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1783951256.824923:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246685800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1783951256.824948:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0247629800 for lustre-MDT0001 00000020:00000080:1.0:1783951256.824963:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0246680000 for lustre-MDT0001 00000100:00100000:1.0:1783951256.824984:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945002880:0@lo:9:umount.0 00000100:00100000:1.0:1783951256.825066:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951256.825101:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945003008:0@lo:9:umount.0 00000100:00100000:1.0:1783951256.825122:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951256.825185:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945000320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951256.825460:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0351b94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3652:x1870607945002496:12345-0@lo:103:ldlm_bl.0 Request processed in 12823us (13021us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783951256.825472:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1783951256.834734:0:20974:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951256.834739:0:20974:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951256.834742:0:20974:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951256.847196:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945002880 00000100:00100000:1.0:1783951256.847210:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945002880 00000100:00100000:1.0:1783951256.847273:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945003008 00000100:00100000:1.0:1783951256.847277:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945003008 00000100:00100000:1.0:1783951256.847321:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783951256.847330:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1870607945002880:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783951256.847359:0:18708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f93cd 00000100:00080000:1.0:1783951256.847367:0:18708:0:(import.c:65:import_set_state_nolock()) ffff9e0247ac8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783951256.847417:0:18708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1783951256.847599:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3651:x1870607945002880:12345-0@lo:9:umount.0 Request processed in 270us (22532us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951256.847606:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783951256.847621:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783951256.847628:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1870607945003008:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783951256.847639:0:18708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9539 00000100:00080000:1.0:1783951256.847659:0:18708:0:(import.c:65:import_set_state_nolock()) ffff9e024762d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783951256.847676:0:18708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1783951256.847764:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3651:x1870607945003008:12345-0@lo:9:umount.0 Request processed in 137us (22640us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951256.847771:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1783951256.847825:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e037e6de000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783951256.847839:0:3651:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783951256.847841:0:3651:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783951256.847845:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945002880:0@lo:9:umount.0 00000100:00080000:1.0:1783951256.847858:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0380fb7000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783951256.847869:0:3651:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783951256.847870:0:3651:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783951256.847873:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945003008:0@lo:9:umount.0 00010000:00010000:1.0:1783951256.847908:0:20974:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783951256.847983:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783951256.848000:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0343609400/0x7645c8e1169f9214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f921b expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.848011:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783951256.848016:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0343609400/0x7645c8e1169f9214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f921b expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.848027:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0343609400/0x7645c8e1169f9214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f921b expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951256.848035:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0343609400/0x7645c8e1169f9214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f921b expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951256.848041:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1783951256.848044:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1783951256.848058:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:0.0:1783951256.850177:0:3654:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.133@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1783951256.850183:0:3654:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783951256.850192:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e0342e81180 x1870607945002496/t0(0) o103->MGC192.168.202.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783951272 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951256.850226:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e0342e82a00 x1870607945002624/t0(0) o103->MGC192.168.202.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783951272 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951256.850237:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e0342e82d80 x1870607945002752/t0(0) o103->MGC192.168.202.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783951272 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783951256.850246:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783951256.850249:0:3654:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783951256.850251:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:2.0:1783951256.852127:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0343609400/0x7645c8e1169f9214 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f921b expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.852156:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951256.852185:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0343609400/0x7645c8e1169f9214 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f921b expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.852209:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0343609400/0x7645c8e1169f9214 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f921b expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.852230:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951256.852232:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951256.852235:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951256.852253:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247a67000/0x7645c8e1169f96b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f96ba expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.852259:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951256.852266:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247a67000/0x7645c8e1169f96b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f96ba expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.852272:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247a67000/0x7645c8e1169f96b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7645c8e1169f96ba expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951256.852281:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951256.852282:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951256.852284:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951256.853215:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:0:1870607945003136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951256.853238:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:3652:1870607945002496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951256.853267:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951256.853273:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b0a9ba1e-8c11-4522-a460-4e640633581c:0:1870607945003264:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1783951256.856006:0:3654:0:(import.c:65:import_set_state_nolock()) ffff9e02482ef000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951256.856021:0:3654:0:(import.c:510:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 512 00000100:00080000:0.0:1783951256.856031:0:3654:0:(import.c:624:import_select_connection()) MGC192.168.202.133@tcp: import ffff9e02482ef000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783951256.856094:0:3654:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037e424a80 x1870607945003392/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951256.856187:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b0a9ba1e-8c11-4522-a460-4e640633581c:3651:1870607945003392:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1783951256.856237:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870607945003392 offset 0 length 520: 4 00000100:00100000:0.0:1783951256.856364:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0a9ba1e-8c11-4522-a460-4e640633581c:3654:1870607945002624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951256.856388:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b0a9ba1e-8c11-4522-a460-4e640633581c:3654:1870607945002752:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1783951256.862009:0:20973:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9e0246b43380) has no exports 00000020:01000000:1.0:1783951256.978541:0:20973:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e02469c70c0 - data ffff9e0349e975e8/ffff9e024658c400 00000020:01000000:1.0:1783951256.978708:0:20973:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e02465f6540 - data ffff9e03724406c0/ffff9e03718f9000 00010000:00010000:2.0:1783951256.979811:0:20974:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1783951256.992741:0:20973:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1783951257.061192:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783951257.061205:0:20973:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783951257.061216:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783951257.063214:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783951257.063222:0:20973:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1783951257.063242:0:20973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783951257.063245:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783951257.068708:0:17941:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783951257.068720:0:17941:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1783951257.068739:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1783951257.070716:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783951257.070726:0:20973:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1783951257.070751:0:20973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783951257.070754:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783951257.071658:0:17943:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783951257.071665:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1783951257.071686:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1783951257.083090:0:20973:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9237 00000020:00000080:3.0:1783951257.083102:0:20973:0:(genops.c:906:class_export_put()) final put ffff9e0246424800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1783951257.083250:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246424800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783951257.084125:0:20973:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f924c 00000020:00000080:3.0:1783951257.084132:0:20973:0:(genops.c:906:class_export_put()) final put ffff9e0380fb0000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1783951257.084205:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1783951257.084212:0:20973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951257.084221:0:20973:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783951257.084225:0:20973:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9e0246b419c0) has no exports 00000004:01000000:3.0:1783951257.084368:0:20973:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783951257.084376:0:20973:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f92a0 00000020:00000080:3.0:1783951257.084380:0:20973:0:(genops.c:906:class_export_put()) final put ffff9e0343db5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783951257.090319:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0380fb0000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1783951257.096028:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1783951257.096053:0:20973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951257.096065:0:20973:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783951257.096071:0:20973:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9e036c2e3380) has no exports 00000020:00000080:3.0:1783951257.096082:0:20973:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9299 00000020:00000080:3.0:1783951257.096093:0:20973:0:(genops.c:906:class_export_put()) final put ffff9e0380fb3000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1783951257.096818:0:20973:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1783951257.096824:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783951257.096828:0:20973:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1783951257.096834:0:20973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783951257.096836:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783951257.096871:0:20973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951257.096880:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783951257.096887:0:20973:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f928b 00000020:00000080:3.0:1783951257.096891:0:20973:0:(genops.c:906:class_export_put()) final put ffff9e03450e3000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1783951257.096896:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1783951257.096899:0:20973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951257.096902:0:20973:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783951257.096905:0:20973:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9e0371853380) has no exports 00000020:00000080:3.0:1783951257.096910:0:20973:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9284 00000020:00000080:3.0:1783951257.096913:0:20973:0:(genops.c:906:class_export_put()) final put ffff9e0246ae0000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1783951257.097223:0:20973:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1783951257.097226:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783951257.097228:0:20973:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1783951257.097232:0:20973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783951257.097233:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783951257.097258:0:20973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951257.097263:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1783951257.097274:0:20973:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1783951257.097279:0:20973:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f926f 00000020:00000080:3.0:1783951257.097284:0:20973:0:(genops.c:906:class_export_put()) final put ffff9e0246ae7800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1783951257.097288:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1783951257.097290:0:20973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951257.097293:0:20973:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783951257.097295:0:20973:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9e036c2e19c0) has no exports 00000020:00000080:3.0:1783951257.097300:0:20973:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9268 00000020:00000080:3.0:1783951257.097302:0:20973:0:(genops.c:906:class_export_put()) final put ffff9e0246ae5000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1783951257.097943:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0343db5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1783951257.097965:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0380fb3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783951257.097971:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0380fb7000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1783951257.097976:0:37:0:(genops.c:906:class_export_put()) final put ffff9e03450e5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783951257.097978:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03450e5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1783951257.097983:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783951257.098068:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03450e3000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1783951257.098073:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246ae0000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783951257.098077:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e037e6de000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1783951257.098080:0:37:0:(genops.c:906:class_export_put()) final put ffff9e0380fb4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783951257.098082:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0380fb4000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1783951257.098085:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783951257.098110:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246ae7800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1783951257.098114:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246ae5000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1783951257.100725:0:20973:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1783951257.100733:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783951257.100738:0:20973:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783951257.100745:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783951257.100800:0:20973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951257.100811:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783951257.100837:0:20973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951257.100851:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783951257.100857:0:20973:0:(genops.c:906:class_export_put()) final put ffff9e0246426000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783951257.100861:0:20973:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246426000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1783951257.100875:0:20973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783951257.101057:0:20973:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9253 00000020:00000080:0.0:1783951257.101066:0:20973:0:(genops.c:906:class_export_put()) final put ffff9e0246ae5800/lustre-MDD0001_UUID 00000020:01000000:0.0:1783951257.101071:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1783951257.101074:0:20973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951257.101079:0:20973:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783951257.101082:0:20973:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9e0246b44d40) has no exports 00000020:00000080:0.0:1783951257.101104:0:20973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951257.101107:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1783951257.101111:0:20973:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f925a 00000020:00000080:0.0:1783951257.101114:0:20973:0:(genops.c:906:class_export_put()) final put ffff9e0246ae1000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1783951257.101122:0:20973:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e024667e000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1783951257.101125:0:20973:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e024667e000 2 00000020:01000004:0.0:1783951257.101127:0:20973:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e024667e000 from lustre-MDT0001 00000020:00000080:0.0:1783951257.101164:0:20973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951257.101168:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1783951257.101170:0:20973:0:(genops.c:906:class_export_put()) final put ffff9e0246422000/lustre-MDT0001_UUID 00000020:00000080:0.0:1783951257.101171:0:20973:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246422000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1783951257.101178:0:20973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1783951257.101208:0:20973:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1783951257.101211:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1783951257.101213:0:20973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951257.101216:0:20973:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783951257.101222:0:20973:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9e024828b000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783951257.101227:0:20973:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9e03779599c0) has exports, disconnecting them 00000020:00080000:0.0:1783951257.101230:0:20973:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9e024828b000), last request at 1783951170 00000020:00000080:0.0:1783951257.101233:0:20973:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f92d8 00000020:00080000:0.0:1783951257.101244:0:20973:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e024828b000): rc 0 00000020:00000080:0.0:1783951257.101254:0:20973:0:(genops.c:906:class_export_put()) final put ffff9e024828b000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1783951257.102122:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0246ae6800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1783951257.102134:0:37:0:(genops.c:906:class_export_put()) final put ffff9e0246ae4800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783951257.102136:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246ae4800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1783951257.102156:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783951257.102264:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246ae5800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1783951257.102268:0:37:0:(genops.c:906:class_export_put()) final put ffff9e0380fb5000/lustre-MDD0001_UUID 00000020:00000080:1.0:1783951257.102270:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0380fb5000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1783951257.102274:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1783951257.102389:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246ae1000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783951257.102393:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024828b000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1783951257.104209:0:20973:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1783951257.104217:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783951257.104222:0:20973:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783951257.104253:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783951257.104286:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e03438c8000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1783951257.104437:0:20973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951257.104447:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1783951257.104451:0:20973:0:(genops.c:906:class_export_put()) final put ffff9e024828c000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1783951257.104455:0:20973:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024828c000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1783951257.104465:0:20973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1783951257.104529:0:20973:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e024667e000 1 00000020:00000080:1.0:1783951257.104535:0:20973:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f91ff 00000020:00000080:1.0:1783951257.104542:0:20973:0:(genops.c:906:class_export_put()) final put ffff9e0248053800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1783951257.104550:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1783951257.104558:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0248053800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783951257.104567:0:20973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951257.104572:0:20973:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783951257.104575:0:20973:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9e0246b40000) has no exports 00000020:00000080:1.0:1783951257.380902:0:20973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951257.380918:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1783951257.380925:0:20973:0:(genops.c:906:class_export_put()) final put ffff9e024667a000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1783951257.380930:0:20973:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024667a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1783951257.380943:0:20973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1783951257.386570:0:20973:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e0246679000 00000020:01000000:1.0:1783951257.386605:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1783951257.386613:0:20973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951257.386619:0:20973:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783951257.387127:0:20973:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9e037d0ab380) has no exports 00000100:00100000:3.0:1783951257.392238:0:17199:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e03436a1a00:17199] 0 exiting: rc = 1 00000100:00100000:3.0:1783951257.392391:0:19450:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e036c56ea00:19450] 3 exiting: rc = 0 00000100:00100000:2.0:1783951257.394400:0:17201:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e02466d6800:17201] 2 exiting: rc = 0 00000100:00100000:2.0:1783951257.394559:0:20540:0:(service.c:3183:ptlrpc_main()) mdt00_005: service thread [ffff9e0249380200:20540] 5 exiting: rc = 0 00000100:00100000:1.0:1783951257.394967:0:17200:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e02466d7400:17200] 1 exiting: rc = 0 00000100:00100000:0.0:1783951257.398976:0:20539:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9e03719ffe00:20539] 4 exiting: rc = 0 00000100:00100000:2.0:1783951257.399385:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399393:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399400:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399407:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399412:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399417:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399422:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399429:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399454:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399459:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399464:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399469:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399474:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399478:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399483:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399488:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399492:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399497:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399502:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399506:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399512:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399518:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399522:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399527:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399532:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399537:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399542:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399547:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399552:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399558:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399563:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399569:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399574:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399579:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399584:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399589:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399595:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399600:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399605:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399610:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399615:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399620:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399635:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399648:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399653:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399659:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399677:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399684:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399689:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399694:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399700:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399704:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399709:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399715:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399720:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399724:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399729:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399735:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399740:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399745:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399751:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399756:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399761:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.399767:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951257.402609:0:17203:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e02466d7c00:17203] 1 exiting: rc = 0 00000100:00100000:0.0:1783951257.403238:0:17202:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e02466d6200:17202] 0 exiting: rc = 1 00000100:00100000:2.0:1783951257.405114:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405129:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405138:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405569:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405575:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405580:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405585:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405591:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405596:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405602:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405607:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405614:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405619:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405756:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405776:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405782:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405787:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405793:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405797:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405803:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405809:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405814:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405820:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405825:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405831:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405838:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405844:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405849:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405855:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405860:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405866:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405871:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405877:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405882:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405887:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405893:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405899:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405904:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405909:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405914:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405920:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405926:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405932:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405937:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405943:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405948:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405954:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405959:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405964:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405977:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405983:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405990:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.405994:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.406000:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.406006:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.406013:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.406018:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.406024:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.406029:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.406035:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.406350:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.406361:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.406367:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.406373:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951257.407235:0:17940:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9e036d340800:17940] 2 exiting: rc = 0 00000100:00100000:0.0:1783951257.407773:0:17205:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e037e6aba00:17205] 1 exiting: rc = 0 00000100:00100000:1.0:1783951257.407947:0:17204:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e03432d0400:17204] 0 exiting: rc = 1 00000100:00100000:2.0:1783951257.408065:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408086:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408092:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408098:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408104:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408110:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408116:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408122:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408128:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408135:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408163:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408171:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408177:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408196:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408203:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408395:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408405:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408412:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408419:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408426:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408443:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408450:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408456:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408462:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408469:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408489:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408497:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408503:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408510:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408516:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408521:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408527:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408533:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408539:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408544:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408550:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408556:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408574:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408580:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408587:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408592:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408598:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408605:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408611:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408617:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408689:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408698:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408704:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408711:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408730:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408737:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408743:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408749:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408757:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408762:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408773:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408779:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408786:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408792:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408798:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408804:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408810:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408816:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.408822:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.439524:0:17207:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e037e6aaa00:17207] 1 exiting: rc = 0 00000100:00100000:1.0:1783951257.439831:0:17206:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e037e6ab200:17206] 0 exiting: rc = 1 00000100:00100000:2.0:1783951257.439932:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.439938:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.439943:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.439949:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.439953:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.439958:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.439963:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.439968:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.439973:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.439978:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.439983:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.439988:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.439992:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.439997:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440002:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440007:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440013:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440018:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440022:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440027:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440032:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440037:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440056:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440062:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440068:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440086:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440090:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440095:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440099:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440103:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440108:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440112:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440116:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440120:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440124:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440128:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440133:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440137:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440166:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440172:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440176:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440181:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440185:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440190:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440194:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440199:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440203:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440436:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440448:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440453:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440458:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440463:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440468:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440473:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440478:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440483:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440488:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440494:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440498:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440503:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440518:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440523:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440528:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.440534:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951257.441397:0:17209:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e037e6ab800:17209] 1 exiting: rc = 0 00000100:00100000:0.0:1783951257.446626:0:17208:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e037e6aa200:17208] 0 exiting: rc = 1 00000100:00100000:2.0:1783951257.452304:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452317:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452323:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452328:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452333:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452337:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452342:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452347:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452353:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452358:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452364:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452386:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452392:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452397:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452402:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452408:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452414:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452419:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452425:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452431:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452437:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452442:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452448:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452453:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452459:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452465:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452470:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452475:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452480:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452485:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452489:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452514:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452518:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452522:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452527:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452532:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452537:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452542:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452547:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452552:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452557:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452562:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452567:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452573:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452578:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452583:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452588:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452595:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452600:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452604:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452609:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452615:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452620:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452625:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452631:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452637:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452642:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452648:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452652:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452657:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452663:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452668:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452673:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.452679:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951257.459957:0:17210:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e037e6ab400:17210] 0 exiting: rc = 1 00000100:00100000:3.0:1783951257.460177:0:17211:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e037e6aa400:17211] 1 exiting: rc = 0 00000100:00100000:0.0:1783951257.462707:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462717:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462723:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462728:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462732:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462736:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462740:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462745:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462750:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462756:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462761:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462766:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462772:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462777:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462783:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462788:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462793:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462798:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462803:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462809:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462814:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462819:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462825:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462830:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462836:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462842:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462847:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462853:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462858:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462877:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462881:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462886:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462890:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462894:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462899:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462903:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462907:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462911:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462916:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462922:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462927:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462933:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462938:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462942:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462947:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462953:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462958:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462963:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462968:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462973:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462978:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462983:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462988:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462993:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.462998:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.463003:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.463008:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.463013:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.463018:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.463023:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.463028:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.463033:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.463037:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.463055:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.463584:0:17213:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e0377b7be00:17213] 1 exiting: rc = 0 00000100:00100000:3.0:1783951257.464290:0:17212:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e037e6aa000:17212] 0 exiting: rc = 1 00000100:00100000:0.0:1783951257.464308:0:17214:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e03465a2800:17214] 2 exiting: rc = 0 00000100:00100000:0.0:1783951257.464356:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464362:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464368:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464375:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464380:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464386:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464391:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464397:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464402:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464408:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464413:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464418:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464423:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464428:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464433:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464438:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464443:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464448:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464454:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464476:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464482:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464487:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464492:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464497:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464503:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464508:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464514:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464520:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464525:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464530:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464535:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464541:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464547:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464564:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464570:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464576:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464582:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464587:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464592:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464597:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464602:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464607:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464612:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464631:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464638:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464643:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464648:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464654:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464660:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464665:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464672:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464678:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464682:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464687:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464692:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464698:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464703:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464708:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464713:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464719:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464724:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464729:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464734:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783951257.464739:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1783951257.472579:0:20973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951257.472592:0:20973:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1783951257.472597:0:20973:0:(genops.c:906:class_export_put()) final put ffff9e03494a4000/MDS_uuid 00000020:00000080:0.0:1783951257.472602:0:20973:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03494a4000/MDS_uuid for MDS 00000020:01000000:0.0:1783951257.472619:0:20973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1783951257.472784:0:20973:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1783951258.023139:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783951258.221951:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) b0a9ba1e-8c11-4522-a460-4e640633581c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951258.221974:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) b0a9ba1e-8c11-4522-a460-4e640633581c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951258.221977:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951258.221982:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951258.221986:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e0246bcb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951258.221994:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 608 00000100:00080000:1.0:1783951258.222001:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783951258.222009:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e0246bcb800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951258.222065:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037d245c00 x1870607945003520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951258.222124:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951258.222128:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951258.222131:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e02481c1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951258.222162:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 608 00000100:00080000:1.0:1783951258.222165:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783951258.222169:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e02481c1000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951258.222183:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037d247100 x1870607945003776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951258.222218:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607945003648:0@lo:400:kworker.0 00000400:00000100:1.0:1783951258.222271:0:3654:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870607945003648 offset 0 length 224: 4 00000100:00100000:1.0:1783951258.222308:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951258.222315:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607945003904:0@lo:400:kworker.0 00000400:00000100:1.0:1783951258.222332:0:3654:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870607945003904 offset 0 length 224: 4 00000100:00100000:2.0:1783951258.222463:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1870607945003520:0@lo:38:kworker.0 00000400:00000100:2.0:1783951258.222487:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870607945003520 offset 0 length 520: 4 00000100:00100000:2.0:1783951258.222499:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1870607945003776:0@lo:38:kworker.0 00000400:00000100:2.0:1783951258.222513:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870607945003776 offset 0 length 520: 4 00010000:00010000:2.0:1783951259.040346:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951260.069817:0:20974:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951261.090365:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951262.123557:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783951262.241253:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b0a9ba1e-8c11-4522-a460-4e640633581c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951262.241264:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b0a9ba1e-8c11-4522-a460-4e640633581c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783951262.241267:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951262.241271:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783951262.241339:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951262.241342:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783951262.241410:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607945004032:0@lo:400:kworker.0 00000400:00000100:1.0:1783951262.241475:0:3652:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870607945004032 offset 0 length 224: 4 00000100:00100000:1.0:1783951262.241528:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951262.241537:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607945004160:0@lo:400:kworker.0 00000400:00000100:1.0:1783951262.241555:0:3652:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870607945004160 offset 0 length 224: 4 00000001:00100000:0.0:1783951262.312683:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783951262.312694:0:18703:0:(genops.c:906:class_export_put()) final put ffff9e0247acd800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783951262.312926:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0247acd800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783951262.312977:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0247ac8000 for lustre-OST0000 00000001:00100000:2.0:1783951262.315582:0:19522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783951262.315595:0:19522:0:(genops.c:906:class_export_put()) final put ffff9e024762c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783951262.315778:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024762c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1783951262.315839:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e024762d800 for lustre-OST0001 00000020:01000004:2.0:1783951262.616745:0:21189:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783951262.629265:0:21189:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1783951262.629333:0:21189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c000/0x7645c8e1169f9372 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9379 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951262.629348:0:21189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c000/0x7645c8e1169f9372 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9379 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951262.629356:0:21189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c000/0x7645c8e1169f9372 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f9379 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951262.629364:0:21189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c000/0x7645c8e1169f9372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f9379 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951262.629395:0:21189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783951262.629401:0:21189:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783951262.629433:0:21189:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783951262.629446:0:21189:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e037d245c00 x1870607945003520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783951278 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951262.629460:0:21189:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783951262.629467:0:21189:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783951262.629492:0:21189:0:(import.c:65:import_set_state_nolock()) ffff9e0246bcb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1783951262.629498:0:21189:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783951262.629503:0:21189:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e037d245c00 x1870607945003520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783951278 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951262.629510:0:21189:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783951262.629580:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1870607945003520:0@lo:38:kworker.0 00010000:00010000:1.0:1783951262.629604:0:20974:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951262.629614:0:20974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c000/0x7645c8e1169f9372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f9379 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951262.629622:0:20974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247b5c000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951262.629626:0:20974:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c000/0x7645c8e1169f9372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f9379 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951262.629637:0:20974:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c000/0x7645c8e1169f9372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f9379 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951262.629645:0:20974:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c000/0x7645c8e1169f9372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f9379 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951262.629651:0:20974:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783951262.629653:0:20974:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783951262.629655:0:20974:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783951262.629671:0:20974:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e02482ef000 00010000:00010000:1.0:1783951262.629673:0:20974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c000/0x7645c8e1169f9372 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f9379 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951262.629678:0:20974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c000/0x7645c8e1169f9372 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f9379 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951262.629696:0:20974:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951262.629697:0:20974:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951262.629699:0:20974:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951262.634201:0:21189:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1783951262.635791:0:21189:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783951262.635815:0:21189:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e037d246d80 x1870607945003648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951274 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951262.636011:0:21189:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e037e426300 x1870607945004032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951278 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951262.636033:0:21189:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783951262.636040:0:21189:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783951262.636085:0:21189:0:(import.c:65:import_set_state_nolock()) ffff9e0246b90000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783951262.636181:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3651:1870607945004288:0@lo:39:umount.0 00000400:00000100:3.0:1783951262.636248:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870607945004288 offset 0 length 224: 4 00000100:00100000:1.0:1783951262.636486:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607945004032:0@lo:400:kworker.0 00000100:00100000:2.0:1783951262.641201:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607945003648:0@lo:400:kworker.0 00010000:00010000:1.0:1783951263.136614:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783951263.264526:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b0a9ba1e-8c11-4522-a460-4e640633581c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951263.264543:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b0a9ba1e-8c11-4522-a460-4e640633581c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951263.264546:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951263.264550:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783951263.264693:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951263.264716:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607945004416:0@lo:400:kworker.0 00000400:00000100:2.0:1783951263.264808:0:3655:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870607945004416 offset 0 length 224: 4 00010000:00010000:3.0:1783951264.163108:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951265.184612:0:20974:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951266.213237:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951266.721235:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951256/real 1783951256] req@ffff9e037e424a80 x1870607945003392/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783951266 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951266.721279:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e037e424a80 x1870607945003392/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783951266 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783951266.721306:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e02482ef000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951266.721348:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1783951266.721353:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b0a9ba1e-8c11-4522-a460-4e640633581c:3651:1870607945003392:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1783951266.721874:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b0a9ba1e-8c11-4522-a460-4e640633581c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951266.721881:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1783951266.721885:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e02482ef000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951266.721891:0:36:0:(import.c:510:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 612 00000100:00080000:2.0:1783951266.721899:0:36:0:(import.c:589:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783951266.721907:0:36:0:(import.c:624:import_select_connection()) MGC192.168.202.133@tcp: import ffff9e02482ef000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783951266.721965:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e024860a300 x1870607945004544/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951266.721993:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951266.721999:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783951266.722476:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607945004672:0@lo:400:kworker.0 00000400:00000100:1.0:1783951266.722544:0:3655:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870607945004672 offset 0 length 224: 4 00000100:00100000:3.0:1783951266.724914:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b0a9ba1e-8c11-4522-a460-4e640633581c:3651:1870607945004544:0@lo:250:kworker.0 00000400:00000100:3.0:1783951266.724996:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870607945004544 offset 0 length 520: 4 00010000:00010000:3.0:1783951267.232535:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951268.258653:0:20974:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951269.290135:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951270.305255:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951271.328773:0:20974:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783951272.032902:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b0a9ba1e-8c11-4522-a460-4e640633581c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951272.032936:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) b0a9ba1e-8c11-4522-a460-4e640633581c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783951272.032940:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951272.032978:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783951272.033306:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607945004800:0@lo:400:kworker.0 00000400:00000100:1.0:1783951272.033387:0:3652:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870607945004800 offset 0 length 224: 4 00010000:00010000:1.0:1783951272.355192:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951272.864283:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951262/real 1783951262] req@ffff9e037e425c00 x1870607945004288/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783951272 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951272.864319:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e037e425c00 x1870607945004288/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783951272 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783951272.864340:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246b90000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783951272.864360:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3651:1870607945004288:0@lo:39:umount.0 00000100:00080000:0.0:1783951272.864415:0:21189:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783951272.864424:0:21189:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783951272.864433:0:21189:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783951272.865979:0:21189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f9348 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f934f expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951272.866392:0:21189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f9348 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f934f expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951272.866421:0:21189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f9348 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f934f expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951272.866429:0:21189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f9348 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f934f expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951272.866539:0:21189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951272.866552:0:21189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343608400/0x7645c8e1169f96a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f96ac expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951272.866559:0:21189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343608400/0x7645c8e1169f96a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f96ac expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951272.866566:0:21189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343608400/0x7645c8e1169f96a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f96ac expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951272.866573:0:21189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0343608400/0x7645c8e1169f96a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f96ac expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951272.874189:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951272.874210:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f9348 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f934f expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951272.874226:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783951272.874231:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f9348 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f934f expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951272.874244:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f9348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f934f expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951272.874253:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f9348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f934f expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951272.874260:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783951272.874264:0:17188:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1783951272.874284:0:17188:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e02482ef000 00010000:00010000:3.0:1783951272.874289:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f9348 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f934f expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951272.874336:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247a66000/0x7645c8e1169f9348 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f934f expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951272.874362:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951272.874367:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0343608400/0x7645c8e1169f96a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f96ac expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951272.874373:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783951272.874377:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0343608400/0x7645c8e1169f96a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f96ac expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951272.874386:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0343608400/0x7645c8e1169f96a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f96ac expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951272.874393:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0343608400/0x7645c8e1169f96a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f96ac expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951272.874399:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783951272.874401:0:17188:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1783951272.874407:0:17188:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e02482ef000 00010000:00010000:3.0:1783951272.874410:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0343608400/0x7645c8e1169f96a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f96ac expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951272.874417:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951272.874419:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951272.874422:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951272.875859:0:21189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783951272.875886:0:21189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0343608400/0x7645c8e1169f96a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f96ac expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951272.875915:0:21189:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1783951272.875927:0:21189:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1783951272.875929:0:21189:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1783951272.882327:0:21189:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1783951272.882339:0:21189:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1783951272.882428:0:21189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951272.882460:0:21189:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783951272.882466:0:21189:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9e036c2e4d40) has no exports 00000020:00080000:0.0:1783951272.883869:0:21189:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9e036c2e4d40) has no exports 00010000:00010000:1.0:1783951272.890446:0:20974:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1783951272.892694:0:21189:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e02480db780 - data ffff9e03725ab360/ffff9e037183cc00 00000020:01000000:3.0:1783951272.892880:0:21189:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e02469c7cc0 - data ffff9e034211a5e8/ffff9e0246b19000 00100000:10000000:1.0:1783951272.901663:0:21189:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783951272.927465:0:21189:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f935d 00000020:00000080:1.0:1783951272.927483:0:21189:0:(genops.c:906:class_export_put()) final put ffff9e02478c4800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1783951272.927507:0:21189:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0343db7000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1783951272.927524:0:21189:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0343db7000 2 00000020:01000004:1.0:1783951272.927529:0:21189:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e0343db7000 from lustre-OST0000 00000020:00000080:1.0:1783951272.927573:0:21189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951272.927587:0:21189:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1783951272.927591:0:21189:0:(genops.c:906:class_export_put()) final put ffff9e02478c7800/lustre-OST0000_UUID 00000020:00000080:1.0:1783951272.927595:0:21189:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02478c7800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1783951272.927603:0:21189:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1783951272.927689:0:21189:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1783951272.927695:0:21189:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1783951272.927700:0:21189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951272.927705:0:21189:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783951272.927714:0:21189:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9e0246bce800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783951272.927720:0:21189:0:(genops.c:1574:class_disconnect_exports()) OBD device 23 (ffff9e036c2e0000) has exports, disconnecting them 00000020:00080000:1.0:1783951272.927726:0:21189:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9e0246bce800), last request at 1783951185 00000020:00000080:1.0:1783951272.927730:0:21189:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9387 00000020:00080000:1.0:1783951272.927741:0:21189:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e0246bce800): rc 0 00000020:00000080:1.0:1783951272.927748:0:21189:0:(genops.c:906:class_export_put()) final put ffff9e0246bce800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783951272.928492:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02478c4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783951272.928510:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246bce800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1783951272.933206:0:21189:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1783951272.933218:0:21189:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783951272.933224:0:21189:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783951272.933234:0:21189:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783951272.933451:0:21189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951272.933463:0:21189:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1783951272.933472:0:21189:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1783951272.933483:0:21189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951272.933489:0:21189:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783951272.933498:0:21189:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9e0246b93800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783951272.933506:0:21189:0:(genops.c:1574:class_disconnect_exports()) OBD device 24 (ffff9e037795cd40) has exports, disconnecting them 00000020:00080000:0.0:1783951272.933511:0:21189:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9e0246b93800), last request at 1783951185 00000020:00000080:0.0:1783951272.933516:0:21189:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f939c 00000020:00080000:0.0:1783951272.933546:0:21189:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e0246b93800): rc 0 00000020:00000080:0.0:1783951272.933551:0:21189:0:(genops.c:906:class_export_put()) final put ffff9e0246b93800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1783951272.934329:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0246bcb800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783951272.934341:0:37:0:(genops.c:906:class_export_put()) final put ffff9e02478c1800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1783951272.934344:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02478c1800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1783951272.934353:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1783951272.934435:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246b93800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1783951273.005756:0:21189:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1783951273.005769:0:21189:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783951273.005775:0:21189:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783951273.005784:0:21189:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783951273.006013:0:21189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951273.006026:0:21189:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1783951273.006038:0:21189:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0343db7000 1 00000020:00000080:1.0:1783951273.006046:0:21189:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f933a 00000020:00000080:1.0:1783951273.006057:0:21189:0:(genops.c:906:class_export_put()) final put ffff9e024821e000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1783951273.006063:0:21189:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1783951273.006068:0:21189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951273.006073:0:21189:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783951273.006077:0:21189:0:(genops.c:1579:class_disconnect_exports()) OBD device 20 (ffff9e037795b380) has no exports 00000020:00000080:3.0:1783951273.009755:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0246b90000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1783951273.009774:0:37:0:(genops.c:906:class_export_put()) final put ffff9e0248021800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1783951273.009778:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0248021800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1783951273.009790:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1783951273.009881:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024821e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783951273.035270:0:21189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951273.035290:0:21189:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1783951273.035298:0:21189:0:(genops.c:906:class_export_put()) final put ffff9e0248100000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1783951273.035317:0:21189:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0248100000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1783951273.035330:0:21189:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1783951273.035515:0:21189:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e0343db7800 00000020:02000400:3.0:1783951273.035586:0:21189:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1783951273.376472:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951274.400351:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1783951274.402918:0:3654:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951258/real 1783951258] req@ffff9e037d247800 x1870607945003904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783951274 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951274.467332:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e037d247800 x1870607945003904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783951274 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783951274.467349:0:3654:0:(import.c:65:import_set_state_nolock()) ffff9e0381195000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783951274.467352:0:3654:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783951274.508544:0:3654:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1783951274.508579:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b0a9ba1e-8c11-4522-a460-4e640633581c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951274.508584:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b0a9ba1e-8c11-4522-a460-4e640633581c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783951274.508599:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951274.508602:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783951274.508605:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951274.508608:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783951274.508611:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e0381195000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951274.508618:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 557 00000100:00080000:0.0:1783951274.508627:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9e0381195000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783951274.508666:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037e426a00 x1870607945004928/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951274.508710:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3651:1870607945004928:0@lo:38:kworker.0 00000400:00000100:0.0:1783951274.508772:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870607945004928 offset 0 length 520: 4 00000100:00100000:0.0:1783951274.508838:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607945003904:0@lo:400:kworker.0 00010000:00010000:1.0:1783951275.435926:0:20974:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951276.448352:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783951276.999505:0:21391:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783951277.013337:0:21391:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1783951277.013434:0:21391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f94d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f94de expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951277.013450:0:21391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f94d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f94de expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951277.013456:0:21391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f94d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f94de expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951277.013462:0:21391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f94d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f94de expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951277.013502:0:21391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783951277.013509:0:21391:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783951277.013537:0:21391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783951277.013549:0:21391:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e037d247100 x1870607945003776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783951278 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951277.013573:0:21391:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783951277.013580:0:21391:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783951277.013586:0:21391:0:(import.c:65:import_set_state_nolock()) ffff9e02481c1000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1783951277.013591:0:21391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783951277.013595:0:21391:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e037d247100 x1870607945003776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783951278 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951277.013602:0:21391:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783951277.013605:0:21391:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00010000:00010000:2.0:1783951277.013650:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951277.013659:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f94d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f94de expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951277.013677:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340031c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783951277.013681:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f94d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f94de expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951277.013688:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f94d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f94de expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951277.013695:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f94d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f94de expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951277.013702:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783951277.013705:0:17188:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783951277.013720:0:17188:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783951277.013736:0:17188:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e02482ef000 00010000:00010000:2.0:1783951277.013740:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f94d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f94de expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951277.013747:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0340031c00/0x7645c8e1169f94d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f94de expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951277.013760:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951277.013762:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951277.013763:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951277.013891:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1870607945003776:0@lo:38:kworker.0 00000100:00080000:0.0:1783951277.015964:0:21391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783951277.015980:0:21391:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e037e424700 x1870607945004160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951278 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951277.016060:0:21391:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e037d244a80 x1870607945004416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951279 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951277.016081:0:21391:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e024860a680 x1870607945004672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951282 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951277.016089:0:21391:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e0342e82300 x1870607945004800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951288 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951277.016096:0:21391:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e037e426a00 x1870607945004928/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783951284 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951277.016115:0:21391:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783951277.016121:0:21391:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783951277.016161:0:21391:0:(import.c:65:import_set_state_nolock()) ffff9e0381195000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1783951277.016167:0:21391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783951277.016172:0:21391:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e037e424700 x1870607945004160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951278 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951277.016231:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607945004672:0@lo:400:kworker.0 00000100:00100000:3.0:1783951277.018698:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607945004160:0@lo:400:kworker.0 00000100:00100000:0.0:1783951277.019034:0:21391:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e037d244a80 x1870607945004416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951279 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951277.019047:0:21391:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e024860a680 x1870607945004672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951282 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951277.019055:0:21391:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e0342e82300 x1870607945004800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951288 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951277.019062:0:21391:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e037e426a00 x1870607945004928/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783951284 ref 1 fl Interpret:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951277.019069:0:21391:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783951277.019111:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607945004416:0@lo:400:kworker.0 00000100:00100000:2.0:1783951277.019217:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3651:1870607945004928:0@lo:38:kworker.0 00000100:00100000:3.0:1783951277.019372:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607945004800:0@lo:400:kworker.0 00000100:00100000:0.0:1783951277.019420:0:21391:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783951277.020591:0:21391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f94ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f94b4 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951277.020606:0:21391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f94ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f94b4 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951277.020613:0:21391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f94ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f94b4 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951277.020619:0:21391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f94ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f94b4 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951277.021044:0:21391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951277.021054:0:21391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343608c00/0x7645c8e1169f9697 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f969e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951277.021076:0:21391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343608c00/0x7645c8e1169f9697 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f969e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951277.021083:0:21391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343608c00/0x7645c8e1169f9697 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f969e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951277.021089:0:21391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9e0343608c00/0x7645c8e1169f9697 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7645c8e1169f969e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951277.021121:0:20974:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951277.021129:0:20974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f94ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f94b4 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951277.021136:0:20974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951277.021205:0:20974:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f94ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f94b4 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951277.021214:0:20974:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f94ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f94b4 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951277.021223:0:20974:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f94ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f94b4 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951277.021229:0:20974:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783951277.021231:0:20974:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1783951277.021244:0:20974:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e02482ef000 00010000:00010000:1.0:1783951277.021248:0:20974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f94ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f94b4 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951277.021255:0:20974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247a66c00/0x7645c8e1169f94ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f94b4 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951277.021270:0:20974:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951277.021274:0:20974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0343608c00/0x7645c8e1169f9697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f969e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951277.021287:0:20974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1783951277.021290:0:20974:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0343608c00/0x7645c8e1169f9697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7645c8e1169f969e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951277.021296:0:20974:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0343608c00/0x7645c8e1169f9697 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f969e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951277.021301:0:20974:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0343608c00/0x7645c8e1169f9697 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f969e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951277.021306:0:20974:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783951277.021308:0:20974:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1783951277.021313:0:20974:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e02482ef000 00010000:00010000:1.0:1783951277.021315:0:20974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0343608c00/0x7645c8e1169f9697 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f969e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951277.021323:0:20974:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951277.021324:0:20974:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951277.021326:0:20974:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951277.021414:0:21391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783951277.021419:0:21391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0343608c00/0x7645c8e1169f9697 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f969e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951277.021435:0:21391:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1783951277.021440:0:21391:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1783951277.021452:0:21391:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1783951277.021479:0:21391:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1783951277.021484:0:21391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1783951277.021489:0:21391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951277.021494:0:21391:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783951277.021499:0:21391:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff9e0371854d40) has no exports 00000020:00080000:0.0:1783951277.021522:0:21391:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff9e0371854d40) has no exports 00010000:00010000:2.0:1783951277.022257:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783951277.024845:0:21391:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e0246b0d420 - data ffff9e0372673510/ffff9e037d134400 00000020:01000000:0.0:1783951277.025045:0:21391:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e0246b0dc00 - data ffff9e03725a6bd0/ffff9e024796ac00 00100000:10000000:0.0:1783951277.035090:0:21391:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1783951277.041428:0:21391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f94c2 00000020:00000080:0.0:1783951277.041441:0:21391:0:(genops.c:906:class_export_put()) final put ffff9e024828a000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1783951277.041466:0:21391:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0246bc8800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1783951277.041470:0:21391:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0246bc8800 2 00000020:01000004:0.0:1783951277.041483:0:21391:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e0246bc8800 from lustre-OST0001 00000020:00000080:0.0:1783951277.041512:0:21391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951277.041522:0:21391:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1783951277.041526:0:21391:0:(genops.c:906:class_export_put()) final put ffff9e0247aca800/lustre-OST0001_UUID 00000020:00000080:0.0:1783951277.041528:0:21391:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0247aca800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1783951277.041535:0:21391:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1783951277.041633:0:21391:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import b0a9ba1e-8c11-4522-a460-4e640633581c->MGS 00010000:00010000:0.0:1783951277.041648:0:21391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0343609800/0x7645c8e1169f9206 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f920d expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951277.041662:0:21391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0343609800/0x7645c8e1169f9206 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f920d expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951277.041669:0:21391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1783951277.041672:0:21391:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1783951277.041675:0:21391:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1783951277.041691:0:21391:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e02482ef000 00010000:00010000:0.0:1783951277.041695:0:21391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0343609800/0x7645c8e1169f9206 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f920d expref: -99 pid: 17931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951277.041708:0:21391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c400/0x7645c8e1169f90f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7645c8e1169f90fc expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951277.041714:0:21391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c400/0x7645c8e1169f90f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7645c8e1169f90fc expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951277.041720:0:21391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783951277.041722:0:21391:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1783951277.041724:0:21391:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1783951277.041732:0:21391:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e02482ef000 00010000:00010000:0.0:1783951277.041735:0:21391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247b5c400/0x7645c8e1169f90f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7645c8e1169f90fc expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783951277.041764:0:21391:0:(import.c:65:import_set_state_nolock()) ffff9e02482ef000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1783951277.041768:0:21391:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783951277.041770:0:21391:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783951277.041772:0:21391:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1783951277.041775:0:21391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783951277.041787:0:21391:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e024860a300 x1870607945004544/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783951281 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783951277.041797:0:21391:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1783951277.041799:0:21391:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:2.0:1783951277.041968:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b0a9ba1e-8c11-4522-a460-4e640633581c:3651:1870607945004544:0@lo:250:kworker.0 00000020:00000080:3.0:1783951277.043458:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024828a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1783951277.043632:0:21391:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1783951277.043647:0:21391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f90e0 00000020:00000080:0.0:1783951277.043656:0:21391:0:(genops.c:906:class_export_put()) final put ffff9e03494a5000/b0a9ba1e-8c11-4522-a460-4e640633581c 00000020:01000000:0.0:1783951277.043679:0:21391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.133@tcp (flags='') 00000020:00000080:0.0:1783951277.043687:0:21391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951277.043693:0:21391:0:(obd_config.c:955:class_cleanup()) MGC192.168.202.133@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783951277.043697:0:21391:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9e0247714d40) has no exports 10000000:01000000:2.0:1783951277.043758:0:17197:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1783951277.043871:0:21391:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.133@tcp: client import never connected 00000100:00080000:0.0:1783951277.043875:0:21391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1783951277.043878:0:21391:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1783951277.043880:0:21391:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1783951277.043882:0:21391:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1783951277.043917:0:21391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951277.043923:0:21391:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.133@tcp (uuid b0a9ba1e-8c11-4522-a460-4e640633581c) 00000020:01000000:0.0:1783951277.043930:0:21391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1783951277.043933:0:21391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951277.043936:0:21391:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783951277.043943:0:21391:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9e02481c6800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783951277.043948:0:21391:0:(genops.c:1574:class_disconnect_exports()) OBD device 27 (ffff9e0351bacd40) has exports, disconnecting them 00000020:00080000:0.0:1783951277.043952:0:21391:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9e02481c6800), last request at 1783951201 00000020:00000080:0.0:1783951277.043956:0:21391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f94ec 00000020:00080000:0.0:1783951277.043973:0:21391:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e02481c6800): rc 0 00000020:00000080:0.0:1783951277.043977:0:21391:0:(genops.c:906:class_export_put()) final put ffff9e02481c6800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1783951277.044699:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e03494a5000/b0a9ba1e-8c11-4522-a460-4e640633581c for MGC192.168.202.133@tcp 00000020:00000080:3.0:1783951277.044710:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e02482ef000 for MGC192.168.202.133@tcp 00000020:00000080:3.0:1783951277.044716:0:37:0:(genops.c:906:class_export_put()) final put ffff9e02482ea800/b0a9ba1e-8c11-4522-a460-4e640633581c 00000020:00000080:3.0:1783951277.044719:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02482ea800/b0a9ba1e-8c11-4522-a460-4e640633581c for MGC192.168.202.133@tcp 00000020:01000000:3.0:1783951277.044731:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.133@tcp (b0a9ba1e-8c11-4522-a460-4e640633581c) 00000020:00000080:3.0:1783951277.044988:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e02481c6800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1783951277.050410:0:21391:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1783951277.050425:0:21391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783951277.050430:0:21391:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783951277.050437:0:21391:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783951277.050591:0:21391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951277.050600:0:21391:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1783951277.050607:0:21391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1783951277.050612:0:21391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951277.050615:0:21391:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783951277.050623:0:21391:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9e024762c000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951277.050629:0:21391:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9e0371850000) has exports, disconnecting them 00000020:00080000:2.0:1783951277.050634:0:21391:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9e024762c000), last request at 1783951201 00000020:00000080:2.0:1783951277.050638:0:21391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f9501 00000020:00080000:2.0:1783951277.050654:0:21391:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e024762c000): rc 0 00000020:00000080:2.0:1783951277.050660:0:21391:0:(genops.c:906:class_export_put()) final put ffff9e024762c000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1783951277.051388:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e02481c1000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1783951277.051398:0:37:0:(genops.c:906:class_export_put()) final put ffff9e0247ac9800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1783951277.051401:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0247ac9800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1783951277.051407:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1783951277.051468:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e024762c000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1783951277.062225:0:21391:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1783951277.062235:0:21391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783951277.062239:0:21391:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783951277.062246:0:21391:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783951277.062281:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e0381195000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1783951277.076616:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1783951277.077295:0:20974:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1783951277.077549:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1783951277.079245:0:17183:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9e0377b7f600:17183] 1 exiting: rc = 0 00000100:00100000:0.0:1783951277.081261:0:17182:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9e0246962200:17182] 0 exiting: rc = 1 00000100:00100000:3.0:1783951277.081410:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.081727:0:17185:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9e0246973a00:17185] 1 exiting: rc = 0 00000100:00100000:0.0:1783951277.082025:0:17186:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9e0246972400:17186] 2 exiting: rc = 0 00000100:00100000:0.0:1783951277.082090:0:18355:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9e0247b8ec00:18355] 3 exiting: rc = 0 00000100:00100000:1.0:1783951277.082605:0:17184:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9e0246973c00:17184] 0 exiting: rc = 1 00000100:00100000:3.0:1783951277.082975:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.082984:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.082990:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.082996:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083002:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083009:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083014:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083019:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083025:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083030:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083035:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083041:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083046:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083052:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083057:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083062:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083068:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083088:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083093:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083099:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083117:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083124:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083130:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083135:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083169:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083176:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083182:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083187:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083193:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083199:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083205:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083210:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083217:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083222:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083228:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083246:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083253:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083258:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083263:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083268:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083274:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083279:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083284:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083289:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083294:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083299:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083305:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083310:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083315:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083320:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083326:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083331:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083345:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083351:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083356:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083361:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083365:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083371:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083376:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083381:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083387:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083392:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083398:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.083404:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1783951277.084929:0:21391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951277.084941:0:21391:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1783951277.084947:0:21391:0:(genops.c:906:class_export_put()) final put ffff9e0246685000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1783951277.084952:0:21391:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246685000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1783951277.084958:0:21391:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1783951277.085008:0:21391:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0246bc8800 1 00000020:00000080:3.0:1783951277.085015:0:21391:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7645c8e1169f94a6 00000020:00000080:3.0:1783951277.085022:0:21391:0:(genops.c:906:class_export_put()) final put ffff9e0247acf000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1783951277.085044:0:21391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1783951277.085048:0:21391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951277.085053:0:21391:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783951277.085056:0:21391:0:(genops.c:1579:class_disconnect_exports()) OBD device 25 (ffff9e0247754d40) has no exports 00000020:00000080:0.0:1783951277.087668:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0247acf000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1783951277.116329:0:21391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951277.116343:0:21391:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1783951277.116349:0:21391:0:(genops.c:906:class_export_put()) final put ffff9e0246bca000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1783951277.116354:0:21391:0:(genops.c:865:class_export_destroy()) destroying export ffff9e0246bca000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1783951277.116367:0:21391:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1783951277.116714:0:21391:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e0246bcf000 00000020:01000000:0.0:1783951277.116748:0:21391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1783951277.116753:0:21391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951277.116758:0:21391:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783951277.116762:0:21391:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9e0351ba99c0) has no exports 00000020:00000080:0.0:1783951277.116789:0:21391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951277.116795:0:21391:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1783951277.116798:0:21391:0:(genops.c:906:class_export_put()) final put ffff9e034886a000/OSS_uuid 00000020:00000080:0.0:1783951277.116800:0:21391:0:(genops.c:865:class_export_destroy()) destroying export ffff9e034886a000/OSS_uuid for OSS 00000020:01000000:0.0:1783951277.116803:0:21391:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1783951277.116896:0:18708:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9e036d342e00:18708] 1 exiting: rc = 0 00000100:00100000:3.0:1783951277.117174:0:18707:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9e0377b7d400:18707] 0 exiting: rc = 1 00000100:00080000:2.0:1783951277.117281:0:17195:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1783951277.117554:0:19194:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9e0245baa800:19194] 3 exiting: rc = 0 00000100:00100000:1.0:1783951277.117623:0:18709:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9e0371a07c00:18709] 2 exiting: rc = 0 00000100:00100000:2.0:1783951277.118277:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118288:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118293:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118299:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118305:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118311:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118316:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118322:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118328:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118334:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118339:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118345:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118350:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118355:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118361:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118367:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118385:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118390:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118396:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118402:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118408:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118413:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118417:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118423:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118428:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118440:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118447:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118453:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118458:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118463:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118468:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118474:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118480:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118486:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118492:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118498:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118503:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118508:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118513:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118520:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118532:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118539:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118543:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118548:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118553:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118563:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118569:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118574:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118585:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118591:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118596:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118608:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118612:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118618:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118622:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118627:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118632:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118638:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118643:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118654:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118661:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118665:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118670:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.118679:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951277.125923:0:18711:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9e0245b37e00:18711] 1 exiting: rc = 0 00000100:00100000:3.0:1783951277.126247:0:18710:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9e0245b36a00:18710] 0 exiting: rc = 1 00000100:00100000:2.0:1783951277.126766:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126774:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126779:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126785:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126790:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126796:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126801:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126806:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126811:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126816:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126822:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126827:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126832:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126837:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126841:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126847:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126851:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126857:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126872:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126879:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126884:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126890:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126909:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126914:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126920:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126925:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126931:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126937:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126942:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126947:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126951:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126956:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126961:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126966:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126971:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126976:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126981:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126986:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126992:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.126996:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127001:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127006:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127010:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127015:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127019:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127023:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127028:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127032:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127037:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127042:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127046:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127052:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127057:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127062:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127066:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127071:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127076:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127089:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127094:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127099:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127104:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127121:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127125:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951277.127137:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.129374:0:18713:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9e0246974000:18713] 1 exiting: rc = 0 00000100:00100000:0.0:1783951277.130331:0:20339:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9e02466fba00:20339] 3 exiting: rc = 0 00000100:00100000:1.0:1783951277.134031:0:18712:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9e0246a57200:18712] 0 exiting: rc = 1 00000100:00100000:1.0:1783951277.134257:0:18714:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9e0246975a00:18714] 2 exiting: rc = 0 00000100:00100000:3.0:1783951277.135051:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135061:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135067:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135073:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135079:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135099:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135163:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135172:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135177:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135183:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135189:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135195:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135203:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135209:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135215:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135221:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135226:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135231:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135237:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135242:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135248:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135253:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135276:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135283:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135288:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135293:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135298:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135303:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135308:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135314:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135320:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135325:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135331:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135336:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135341:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135348:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135353:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135359:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135364:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135370:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135375:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135388:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135393:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135399:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135404:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135409:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135446:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135453:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135458:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135463:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135468:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135474:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135480:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135485:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135491:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135495:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135500:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135506:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135511:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135517:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135522:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135529:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135534:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.135551:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951277.148934:0:18715:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9e0246408000:18715] 0 exiting: rc = 1 00000100:00100000:3.0:1783951277.149425:0:18716:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9e036c571600:18716] 1 exiting: rc = 0 00000100:00100000:3.0:1783951277.149505:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149513:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149518:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149523:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149528:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149533:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149537:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149542:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149546:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149551:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149556:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149571:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149576:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149581:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149586:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149592:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149598:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149603:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149608:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149614:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149618:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149623:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149628:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149633:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149638:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149643:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149648:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149653:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149657:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149662:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149667:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149672:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149678:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149683:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149688:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149693:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149698:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149875:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149885:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149890:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149895:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149900:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149905:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149910:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149915:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149920:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149933:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149938:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149944:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149949:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149955:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149961:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149966:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149971:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149975:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149981:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149987:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149992:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.149997:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.150002:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.150007:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.150012:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.150017:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.150022:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951277.154001:0:18717:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9e02476c2a00:18717] 0 exiting: rc = 1 00000100:00100000:1.0:1783951277.154593:0:18718:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9e036c570200:18718] 1 exiting: rc = 0 00000100:00100000:3.0:1783951277.154811:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.154819:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.154832:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.154840:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.154845:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.154850:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.154856:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.154895:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.154902:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.154908:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.154916:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.154923:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.154929:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.154936:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.154943:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.154949:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.154956:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.154970:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.154976:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.154996:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.155004:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.155010:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.155015:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.155021:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.155027:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.155032:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.155038:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.155044:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.155049:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.155054:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.155059:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.155080:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.155087:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.155094:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.155100:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.160936:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.160955:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.160959:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.160964:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.160968:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.160973:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.160978:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.160981:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161006:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161010:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161015:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161019:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161023:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161029:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161033:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161036:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161040:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161058:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161062:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161066:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161080:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161085:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161089:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161093:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161098:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161102:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161106:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161110:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951277.161119:0:21391:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1783951277.174060:0:21391:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1783951297.562590:0:22156:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1783951308.143004:0:22756:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783951308.143013:0:22756:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1783951308.143015:0:22756:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783951308.143451:0:22756:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e037ca6d800 00000020:01000004:2.0:1783951308.143473:0:22756:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1783951308.143482:0:22756:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783951308.143500:0:22756:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e0377958000) 00000020:00000080:2.0:1783951308.143520:0:22756:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783951308.212322:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1783951308.219682:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1783951308.224359:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1783951308.226074:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1783951308.226839:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1783951308.227626:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1783951308.228872:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1783951308.230357:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1783951308.232108:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1783951308.233184:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1783951308.233627:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1783951308.234084:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1783951308.234369:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1783951308.234870:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1783951308.235109:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1783951308.235351:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1783951308.235685:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1783951308.236572:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1783951308.236867:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1783951308.237770:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1783951308.238118:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1783951308.238357:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1783951308.238637:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1783951308.238935:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1783951308.239125:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1783951308.239417:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1783951308.240044:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1783951308.242393:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1783951308.243620:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1783951308.245194:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1783951308.245859:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1783951308.246316:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1783951308.249045:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1783951308.252117:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1783951308.252996:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1783951308.254718:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1783951308.256998:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1783951308.257893:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1783951308.258188:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783951308.258715:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1783951308.259048:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1783951308.259611:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1783951308.259944:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1783951308.260192:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1783951308.260391:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1783951308.260767:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1783951308.260975:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1783951308.264602:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1783951308.265233:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1783951308.265721:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1783951308.269269:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1783951308.270199:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1783951308.270721:0:22756:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:1.0:1783951308.271505:0:22756:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783951308.271878:0:22756:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1783951308.271899:0:22756:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783951308.271914:0:22756:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f9953 00000020:01000004:1.0:1783951308.271925:0:22756:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1783951308.271930:0:22756:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1783951308.271936:0:22756:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e037ca6d800 from MGS 00000020:01000004:1.0:1783951308.271940:0:22756:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1783951308.271953:0:22756:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e0371853380) 00000020:00000080:1.0:1783951308.271964:0:22756:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1783951308.272769:0:22756:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e037ca6d800 from MGS, refs=2 00080000:01000000:1.0:1783951308.272780:0:22756:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783951308.272788:0:22756:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f9961 00000100:00100000:1.0:1783951308.272926:0:22756:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1783951308.273069:0:22756:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1783951308.273076:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1783951308.274416:0:22756:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1783951308.274444:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1783951308.276985:0:22756:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951308.277186:0:22756:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1783951308.277193:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1783951308.278263:0:22756:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1783951308.278272:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1783951308.278911:0:22756:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1783951308.278918:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1783951308.283288:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951308.283295:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951308.283298:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951308.283814:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951308.283817:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951308.283819:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951308.284469:0:22756:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1783951308.287244:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1783951308.295256:0:22756:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1783951308.297277:0:22768:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783951308.297628:0:22756:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783951308.297691:0:22756:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783951308.300770:0:22756:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783951308.301233:0:22756:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783951308.301426:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783951308.303227:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1783951308.308686:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1783951308.308707:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783951308.311337:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783951308.311352:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1783951308.313875:0:22756:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1783951308.313906:0:22756:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.133@tcp' 00000020:01000004:2.0:1783951308.313908:0:22756:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1783951308.313948:0:22756:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.133@tcp (typ=mgc) 00000020:00000080:2.0:1783951308.313963:0:22756:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.133@tcp (ffff9e037795b380) 00000020:00000080:2.0:1783951308.313993:0:22756:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1783951308.314098:0:22756:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e03429f1800@MGC192.168.202.133@tcp: add connection 192.168.202.133@tcp at head 00000100:00080000:3.0:1783951308.314324:0:22773:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:2.0:1783951308.315882:0:22756:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.133@tcp-0 is initialized 00000040:01000000:2.0:1783951308.315895:0:22756:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 1 is initialized 10000000:01000000:0.0:1783951308.317488:0:22774:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1783951308.317595:0:22756:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.133@tcp (uuid 3b1b2cfa-7097-4258-904b-0084ac551497) 00000020:00000080:2.0:1783951308.317625:0:22756:0:(genops.c:1406:class_connect()) connect: client 3b1b2cfa-7097-4258-904b-0084ac551497, cookie 0x7645c8e1169f996f 00000100:00080000:2.0:1783951308.317640:0:22756:0:(import.c:510:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951308.317647:0:22756:0:(import.c:624:import_select_connection()) MGC192.168.202.133@tcp: import ffff9e03429f1800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783951308.317688:0:22756:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0248608000 x1870607945005056/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951308.317720:0:22756:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3b1b2cfa-7097-4258-904b-0084ac551497->MGS 00000020:01000004:2.0:1783951308.317754:0:22756:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783951308.317760:0:22756:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1783951308.317776:0:22756:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e037795cd40) 00000020:00000080:2.0:1783951308.317789:0:22756:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1783951308.317854:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3b1b2cfa-7097-4258-904b-0084ac551497:3651:1870607945005056:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1783951308.317950:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951308.320311:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945005056 00000100:00100000:0.0:1783951308.320330:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945005056 00000100:00100000:0.0:1783951308.320395:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951308.320405:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ca4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3651:x1870607945005056:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1783951308.320449:0:22769:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 3b1b2cfa-7097-4258-904b-0084ac551497@0@lo t0 exp 0000000000000000 cur 663 last 0 00000020:00000080:0.0:1783951308.320491:0:22769:0:(genops.c:1406:class_connect()) connect: client 3b1b2cfa-7097-4258-904b-0084ac551497, cookie 0x7645c8e1169f997d 00000100:00080000:0.0:1783951308.320671:0:22769:0:(import.c:65:import_set_state_nolock()) ffff9e0359cd3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951308.320793:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ca4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+5:3651:x1870607945005056:12345-0@lo:250:mount.lustre.0 Request processed in 387us (2844us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951308.320802:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783951308.320964:0:3651:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.133@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1783951308.320978:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.133@tcp: connect to target with instance 0 00000100:00080000:1.0:1783951308.320986:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.133@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1783951308.320992:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1783951308.320996:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e03429f1800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1783951308.320999:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1783951308.321013:0:3651:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1783951308.321019:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3b1b2cfa-7097-4258-904b-0084ac551497:3651:1870607945005056:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783951308.345240:0:22756:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951308.346306:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1783951308.346314:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1783951308.349249:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1783951308.349268:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1783951308.349897:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1783951308.349905:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1783951308.355598:0:22756:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783951308.355831:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1783951308.355840:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1783951308.357747:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1783951308.357766:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1783951308.443169:0:22756:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951308.443492:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1783951308.443500:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1783951308.450460:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1783951308.450475:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1783951308.451783:0:22756:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951308.451950:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783951308.451955:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1783951308.452512:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783951308.452517:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1783951308.452956:0:22756:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951308.453076:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783951308.453081:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1783951308.455836:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783951308.455850:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1783951308.458749:0:22756:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951308.458928:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783951308.458932:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1783951308.459506:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783951308.459511:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1783951308.486973:0:22756:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951308.488499:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783951308.488508:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1783951308.489775:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783951308.489785:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1783951308.490798:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783951308.490808:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1783951308.491631:0:22756:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1783951308.491660:0:22756:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1783951308.491666:0:22756:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.133@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1783951308.491779:0:22756:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783951308.491813:0:22756:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.133@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1783951308.491818:0:22756:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783951308.491819:0:22756:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783951308.491821:0:22756:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951308.491822:0:22756:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951308.491823:0:22756:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951308.491824:0:22756:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951308.491829:0:22756:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951308.491830:0:22756:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783951308.491833:0:22756:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951308.491834:0:22756:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783951308.491836:0:22756:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1783951308.491838:0:22756:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783951308.491839:0:22756:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783951308.491840:0:22756:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951308.491842:0:22756:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951308.491842:0:22756:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951308.491843:0:22756:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951308.491844:0:22756:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951308.491845:0:22756:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783951308.491846:0:22756:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951308.491847:0:22756:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783951308.491875:0:22756:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783951308.491903:0:22756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945005184:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783951308.491961:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951308.492002:0:22756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036d3a09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951308.492667:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945005184 00000100:00100000:2.0:1783951308.492676:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945005184 00000100:00100000:2.0:1783951308.492714:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783951308.492725:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ca49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+5:22756:x1870607945005184:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783951308.492775:0:22772:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783951308.492778:0:22772:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783951308.492781:0:22772:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1783951308.493220:0:22793:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783951308.494470:0:22772:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1783951308.496905:0:22794:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1783951308.496914:0:22794:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1783951308.496917:0:22794:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1783951308.496920:0:22794:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1783951308.497600:0:22794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1783951308.497810:0:22772:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783951308.497820:0:22772:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1783951308.501686:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ca49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+5:22756:x1870607945005184:12345-0@lo:253:mount.lustre.0 Request processed in 8954us (9714us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951308.501699:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783951308.501859:0:22756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945005184:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783951308.501873:0:22756:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783951308.501876:0:22756:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783951308.501877:0:22756:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783951308.501890:0:22756:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951308.501891:0:22756:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951308.501892:0:22756:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951308.501892:0:22756:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951308.501894:0:22756:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951308.501895:0:22756:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783951308.501897:0:22756:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951308.501898:0:22756:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783951308.501927:0:22756:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e037ca6d800 from lustre-MDT0000 10000000:01000000:0.0:1783951308.501956:0:22756:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1783951308.501960:0:22756:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783951308.501964:0:22756:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e037795b380 10000000:01000000:0.0:1783951308.501968:0:22756:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783951308.501976:0:22756:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e037795b380 from 1 10000000:01000000:0.0:1783951308.501979:0:22756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783951308.502016:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f9984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.502027:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f9984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.502037:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f9984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951308.502057:0:22756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945005312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951308.502094:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951308.502136:0:22756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036d3a00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951308.502231:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945005312 00000100:00100000:3.0:1783951308.502237:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945005312 00000100:00100000:3.0:1783951308.502269:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783951308.502277:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ca48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+5:22756:x1870607945005312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951308.502290:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951308.502306:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03427e8e00/0x7645c8e1169f998b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9984 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951308.502336:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03427e8e00/0x7645c8e1169f998b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9984 expref: 6 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951308.502344:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03427e8e00/0x7645c8e1169f998b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9984 expref: 6 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951308.502351:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e8e00, rc 0) 00000100:00100000:3.0:1783951308.502400:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ca48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+6:22756:x1870607945005312:12345-0@lo:101:mount.lustre.0 Request processed in 125us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951308.502404:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783951308.502708:0:22756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945005312:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951308.502722:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f9984 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f998b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951308.502741:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f9984 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f998b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951308.502799:0:22756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945005440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951308.502827:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951308.502858:0:22756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b2f5480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951308.502935:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945005440 00000100:00100000:0.0:1783951308.502939:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945005440 00000100:00100000:0.0:1783951308.502968:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783951308.502974:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ca49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+6:22756:x1870607945005440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951308.503042:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ca49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+6:22756:x1870607945005440:12345-0@lo:501:mount.lustre.0 Request processed in 69us (214us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783951308.503047:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783951308.503776:0:22756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945005440:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783951308.503810:0:22756:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783951308.503826:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f9984 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f998b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951308.503835:0:22756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f9984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f998b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951308.503844:0:22756:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e037ca6d800 10000000:01000000:2.0:1783951308.503849:0:22756:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783951308.503853:0:22756:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e037ca6d800 10000000:01000000:2.0:1783951308.503856:0:22756:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783951308.503859:0:22756:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9e037ca6d800 from 1 10000000:01000000:2.0:1783951308.503862:0:22756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783951308.503903:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948200/0x7645c8e1169f9992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951308.503911:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247948200/0x7645c8e1169f9992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951308.503920:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247948200/0x7645c8e1169f9992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951308.503946:0:22756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945005568:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951308.503983:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951308.504008:0:22756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b2f5480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951308.504371:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945005568 00000100:00100000:0.0:1783951308.504387:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945005568 00000100:00100000:0.0:1783951308.504619:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783951308.504629:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+6:22756:x1870607945005568:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951308.504649:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951308.504663:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b3400/0x7645c8e1169f9999 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9992 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.504684:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b3400/0x7645c8e1169f9999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9992 expref: 7 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.504693:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b3400/0x7645c8e1169f9999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9992 expref: 7 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.504701:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3400, rc 0) 00000100:00100000:0.0:1783951308.504751:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+7:22756:x1870607945005568:12345-0@lo:101:mount.lustre.0 Request processed in 123us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951308.504757:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783951308.504981:0:22756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945005568:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951308.504995:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247948200/0x7645c8e1169f9992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9999 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951308.505004:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247948200/0x7645c8e1169f9992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9999 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951308.505019:0:22756:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783951308.505038:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948200/0x7645c8e1169f9992 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9999 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951308.505046:0:22756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247948200/0x7645c8e1169f9992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9999 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951308.505052:0:22756:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783951308.505056:0:22756:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783951308.505061:0:22756:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e037ca6d800 10000000:01000000:2.0:1783951308.505063:0:22756:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783951308.505066:0:22756:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1783951308.505069:0:22756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783951308.505085:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f99a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951308.505092:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f99a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951308.505106:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f99a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951308.505122:0:22756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945005696:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951308.505169:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951308.505694:0:22756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036b2f5480 going to sleep for 11 seconds 00000100:00100000:3.0:1783951308.505733:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945005696 00000100:00100000:3.0:1783951308.505739:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945005696 00000100:00100000:3.0:1783951308.505772:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783951308.505780:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+7:22756:x1870607945005696:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951308.505789:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951308.505800:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03427e9e00/0x7645c8e1169f99a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f99a0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951308.505817:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03427e9e00/0x7645c8e1169f99a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f99a0 expref: 8 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951308.505826:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03427e9e00/0x7645c8e1169f99a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f99a0 expref: 8 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951308.505832:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e9e00, rc 0) 00000100:00100000:3.0:1783951308.505901:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+8:22756:x1870607945005696:12345-0@lo:101:mount.lustre.0 Request processed in 121us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951308.505908:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783951308.506762:0:22756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945005696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951308.506782:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f99a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f99a7 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951308.506791:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f99a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f99a7 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951308.506865:0:22756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945005824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951308.506918:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951308.506962:0:22756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342e27300 going to sleep for 11 seconds 00000100:00100000:1.0:1783951308.507088:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945005824 00000100:00100000:1.0:1783951308.507094:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945005824 00000100:00100000:1.0:1783951308.507118:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783951308.507124:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+8:22756:x1870607945005824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951308.507292:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+9:22756:x1870607945005824:12345-0@lo:501:mount.lustre.0 Request processed in 167us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951308.507310:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783951308.507489:0:22756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945005824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951308.507524:0:22756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945005952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951308.507559:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951308.507596:0:22756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342e27300 going to sleep for 11 seconds 00000100:00100000:1.0:1783951308.507650:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945005952 00000100:00100000:1.0:1783951308.507655:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945005952 00000100:00100000:1.0:1783951308.507674:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783951308.507680:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+9:22756:x1870607945005952:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951308.510695:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+9:22756:x1870607945005952:12345-0@lo:503:mount.lustre.0 Request processed in 3006us (3126us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951308.510708:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783951308.511101:0:22756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945005952:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951308.511881:0:22795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b1b2cfa-7097-4258-904b-0084ac551497:22795:1870607945006080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951308.511941:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951308.512013:0:22795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342972cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951308.512053:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945006080 00000100:00100000:0.0:1783951308.512060:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945006080 00000100:00100000:0.0:1783951308.512104:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783951308.512113:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+9:22795:x1870607945006080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951308.513174:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+9:22795:x1870607945006080:12345-0@lo:502:llog_process_th.0 Request processed in 1058us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951308.513185:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783951308.513568:0:22795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b1b2cfa-7097-4258-904b-0084ac551497:22795:1870607945006080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783951308.513664:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951308.513676:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951308.513678:0:22795:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783951308.513683:0:22795:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783951308.513686:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783951308.513702:0:22795:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e03718519c0) 00000020:00000080:1.0:1783951308.513720:0:22795:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1783951308.513725:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783951308.513811:0:22795:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783951308.513819:0:22795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f99b5 00000020:00000080:1.0:1783951308.514040:0:22795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783951308.514045:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951308.514049:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951308.514050:0:22795:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783951308.514052:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951308.514056:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951308.514057:0:22795:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783951308.514061:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783951308.514068:0:22795:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e0371850000) 00000020:00000080:1.0:1783951308.514077:0:22795:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1783951308.514088:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783951308.514090:0:22795:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783951308.514092:0:22795:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783951308.514098:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783951308.514289:0:22795:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e037ca6d800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783951308.514304:0:22795:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e0371854d40) 00000020:00000080:1.0:1783951308.514313:0:22795:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1783951308.514717:0:22795:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783951308.514726:0:22795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f99ca 00000020:00000080:1.0:1783951308.514829:0:22795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783951308.514836:0:22795:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783951308.514840:0:22795:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7645c8e1169f99d1 00080000:01000000:1.0:1783951308.514845:0:22795:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783951308.514848:0:22795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f99d8 00010000:00010000:2.0:1783951308.601526:0:22795:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1783951308.602038:0:22795:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934627 00000001:00080000:2.0:1783951308.602478:0:22795:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783951308.603183:0:22795:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e03779599c0) 00000020:00000080:2.0:1783951308.603210:0:22795:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783951308.603288:0:22795:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783951308.603296:0:22795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f99e6 00000020:00000080:2.0:1783951308.603927:0:22795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783951308.612509:0:22795:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7645c8e1169f99ed 00000020:00000080:0.0:1783951308.613339:0:22795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1783951308.613352:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951308.613358:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951308.613366:0:22795:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1783951308.613472:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783951308.613475:0:22795:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1783951308.613477:0:22795:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783951308.613479:0:22795:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783951308.613480:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783951308.613483:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951308.613485:0:22795:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783951308.613488:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951308.613492:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951308.613494:0:22795:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1783951308.613498:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783951308.613536:0:22795:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1783951308.613551:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951308.613554:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951308.613555:0:22795:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1783951308.613557:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951308.613560:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951308.613561:0:22795:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1783951308.613565:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783951308.613569:0:22795:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:00000080:0.0:1783951308.613612:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783951308.613631:0:22795:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9e0351bab380) 00000020:00000080:0.0:1783951308.613646:0:22795:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1783951308.613651:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783951308.614337:0:22795:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1783951308.614345:0:22795:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783951308.614353:0:22795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f99fb 00010000:00080000:0.0:1783951308.614518:0:22795:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0342df1000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.133@tcp at head 00010000:00010000:0.0:1783951308.619065:0:22795:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1783951308.625130:0:22795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951308.625183:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783951308.625367:0:22795:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783951308.625399:0:22795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f9a02 00000100:00080000:2.0:1783951308.625411:0:22795:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951308.625426:0:22795:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e0342df1000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783951308.625461:0:22795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0248608700 x1870607945006208/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951308.625489:0:22795:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1783951308.625571:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945006208:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783951308.625651:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951308.625732:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945006208 00000100:00100000:1.0:1783951308.625740:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945006208 00000100:00100000:1.0:1783951308.625768:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783951308.625775:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1870607945006208:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1783951308.625790:0:22782:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:01000000:2.0:1783951308.626547:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951308.626552:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951308.626554:0:22795:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1783951308.626558:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783951308.626569:0:22795:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1783951308.626571:0:22795:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783951308.626581:0:22795:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783951308.626583:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783951308.626586:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951308.626588:0:22795:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783951308.626590:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783951308.626595:0:22795:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783951308.626598:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951308.626599:0:22795:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783951308.626602:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783951308.626606:0:22795:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:01000000:2.0:1783951308.626628:0:22795:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783951308.626630:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783951308.626645:0:22795:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e0247714d40) 00000020:00000080:2.0:1783951308.626661:0:22795:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1783951308.626665:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783951308.626733:0:22795:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783951308.626739:0:22795:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783951308.626744:0:22795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f9a10 00010000:00080000:2.0:1783951308.626771:0:22795:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e037e6db800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.133@tcp at head 00010000:00010000:2.0:1783951308.626970:0:22795:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1783951308.629768:0:22795:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783951308.630809:0:22795:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783951308.640192:0:22795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783951308.640857:0:22795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1783951308.682460:0:22795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000100:00100000:0.0:1783951308.682638:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1870607945006208:12345-0@lo:38:llog_process_th.0 Request processed in 56857us (56982us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951308.682664:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1783951308.683186:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0342df1000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951308.683204:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783951308.683209:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945006208:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1783951308.684267:0:22801:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1783951308.684273:0:22801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1783951308.686017:0:22795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783951308.686031:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783951308.686072:0:22795:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783951308.686090:0:22795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f9a17 00000100:00080000:0.0:1783951308.686101:0:22795:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783951308.686107:0:22795:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e037e6db800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783951308.686175:0:22795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037e425f80 x1870607945006336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783951308.686314:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945006336:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783951308.686368:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607945006336 offset 0 length 520: 4 00000100:00080000:0.0:1783951308.686458:0:22795:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1783951308.686524:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951308.686539:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951308.686541:0:22795:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783951308.686545:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783951308.686548:0:22795:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1783951308.686549:0:22795:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783951308.686551:0:22795:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783951308.686553:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783951308.686556:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951308.686557:0:22795:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783951308.686560:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783951308.686563:0:22795:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1783951308.686566:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951308.686567:0:22795:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1783951308.686570:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783951308.686583:0:22795:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:01000000:0.0:1783951308.686609:0:22795:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783951308.686612:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783951308.686634:0:22795:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e0351ba8000) 00000020:00000080:0.0:1783951308.686646:0:22795:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1783951308.686651:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783951308.686733:0:22795:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1783951308.686739:0:22795:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:0.0:1783951308.686745:0:22795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7645c8e1169f9a25 00010000:00080000:0.0:1783951308.686777:0:22795:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e035079f800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.133@tcp at head 00010000:00010000:0.0:1783951308.686978:0:22795:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1783951308.687052:0:22795:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783951308.687068:0:22795:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783951308.704335:0:22795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783951308.705812:0:22795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1783951308.706002:0:22795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1783951308.706785:0:22803:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1783951308.706790:0:22803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783951308.707640:0:22795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783951308.707655:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783951308.707692:0:22795:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783951308.707712:0:22795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f9a2c 00000100:00080000:0.0:1783951308.707723:0:22795:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783951308.707729:0:22795:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e035079f800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783951308.707765:0:22795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037e426680 x1870607945006464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951308.707798:0:22795:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1783951308.707857:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951308.707862:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951308.707863:0:22795:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783951308.707867:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951308.707872:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951308.707873:0:22795:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783951308.707876:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783951308.707878:0:22795:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783951308.707880:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951308.707882:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951308.707883:0:22795:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783951308.707886:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951308.707898:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951308.707899:0:22795:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783951308.707903:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783951308.707937:0:22795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b1b2cfa-7097-4258-904b-0084ac551497:22795:1870607945006592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951308.708174:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945006464:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783951308.708224:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607945006464 offset 0 length 520: 4 00000100:00100000:0.0:1783951308.708823:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951308.708887:0:22795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036d3a0600 going to sleep for 11 seconds 00000100:00100000:2.0:1783951308.710248:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945006592 00000100:00100000:2.0:1783951308.710273:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945006592 00000100:00100000:2.0:1783951308.710334:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783951308.710344:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+9:22795:x1870607945006592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951308.710784:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+9:22795:x1870607945006592:12345-0@lo:502:llog_process_th.0 Request processed in 440us (1961us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951308.710794:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783951308.711897:0:22795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b1b2cfa-7097-4258-904b-0084ac551497:22795:1870607945006592:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783951308.711939:0:22795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951308.711946:0:22795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951308.711948:0:22795:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783951308.711953:0:22795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1783951308.713292:0:22756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1783951308.713322:0:22756:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783951308.713357:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f99a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f99a7 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951308.713370:0:22756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247948800/0x7645c8e1169f99a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f99a7 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951308.713378:0:22756:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e037ca6d800 from 1 10000000:01000000:3.0:1783951308.713380:0:22756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783951308.713609:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03427e9a00/0x7645c8e1169f9a33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951308.713618:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e03427e9a00/0x7645c8e1169f9a33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951308.713628:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e03427e9a00/0x7645c8e1169f9a33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951308.713654:0:22756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945006720:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783951308.713724:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951308.713780:0:22756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342e27a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783951308.713914:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945006720 00000100:00100000:0.0:1783951308.713921:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945006720 00000100:00100000:0.0:1783951308.713973:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951308.713982:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+9:22756:x1870607945006720:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951308.713994:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951308.714009:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9a3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9a33 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.714033:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9a3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9a33 expref: 10 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.714044:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9a3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9a33 expref: 10 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.714053:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2600, rc 0) 00000100:00100000:0.0:1783951308.714108:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+10:22756:x1870607945006720:12345-0@lo:101:mount.lustre.0 Request processed in 127us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951308.714115:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783951308.714635:0:22756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945006720:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951308.714654:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e03427e9a00/0x7645c8e1169f9a33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9a3a expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951308.714663:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e03427e9a00/0x7645c8e1169f9a33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9a3a expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951308.715492:0:22756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945006848:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1783951308.715686:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951308.715771:0:22756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348bc0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951308.715828:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945006848 00000100:00100000:2.0:1783951308.715835:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945006848 00000100:00100000:2.0:1783951308.715935:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783951308.715944:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+10:22756:x1870607945006848:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783951308.715961:0:22771:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783951308.715967:0:22771:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783951308.716047:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+10:22756:x1870607945006848:12345-0@lo:256:mount.lustre.0 Request processed in 104us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951308.716053:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783951308.716123:0:22756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945006848:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1783951308.716772:0:22756:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783951308.716795:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03427e9a00/0x7645c8e1169f9a33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9a3a expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951308.716805:0:22756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e03427e9a00/0x7645c8e1169f9a33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9a3a expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951308.716813:0:22756:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e037ca6d800 from 1 10000000:01000000:1.0:1783951308.716816:0:22756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783951308.716848:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c2600/0x7645c8e1169f9a41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951308.716858:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e03413c2600/0x7645c8e1169f9a41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951308.716871:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e03413c2600/0x7645c8e1169f9a41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951308.716888:0:22756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945006976:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783951308.716925:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951308.717479:0:22756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348bc0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783951308.717655:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945006976 00000100:00100000:3.0:1783951308.717662:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945006976 00000100:00100000:3.0:1783951308.717697:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783951308.717706:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+10:22756:x1870607945006976:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951308.717719:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951308.717735:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9a48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9a41 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951308.717758:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9a48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9a41 expref: 11 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951308.717787:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9a48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9a41 expref: 11 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951308.717796:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e8800, rc 0) 00000100:00100000:3.0:1783951308.717858:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+11:22756:x1870607945006976:12345-0@lo:101:mount.lustre.0 Request processed in 153us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951308.717864:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783951308.717948:0:22756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945006976:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951308.717963:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e03413c2600/0x7645c8e1169f9a41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9a48 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951308.717983:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e03413c2600/0x7645c8e1169f9a41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9a48 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951308.718043:0:22756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945007104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951308.718072:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951308.718095:0:22756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348bc0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783951308.718157:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945007104 00000100:00100000:3.0:1783951308.718162:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945007104 00000100:00100000:3.0:1783951308.718180:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783951308.718185:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+11:22756:x1870607945007104:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951308.718556:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+11:22756:x1870607945007104:12345-0@lo:501:mount.lustre.0 Request processed in 370us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951308.718563:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783951308.720626:0:22756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945007104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951308.720708:0:22756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945007232:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951308.720774:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951308.720804:0:22756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348bc0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951308.720883:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945007232 00000100:00100000:2.0:1783951308.720890:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945007232 00000100:00100000:2.0:1783951308.720994:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783951308.721005:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+11:22756:x1870607945007232:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951308.721122:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+11:22756:x1870607945007232:12345-0@lo:503:mount.lustre.0 Request processed in 119us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951308.721129:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783951308.721239:0:22756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945007232:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951308.722696:0:22805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b1b2cfa-7097-4258-904b-0084ac551497:22805:1870607945007360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951308.722764:0:22805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951308.722914:0:22805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348bc0780 going to sleep for 11 seconds 00000100:00100000:3.0:1783951308.722995:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945007360 00000100:00100000:3.0:1783951308.723003:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945007360 00000100:00100000:3.0:1783951308.723037:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783951308.723045:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+11:22805:x1870607945007360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951308.723702:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+11:22805:x1870607945007360:12345-0@lo:502:llog_process_th.0 Request processed in 655us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951308.723711:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783951308.723812:0:22805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b1b2cfa-7097-4258-904b-0084ac551497:22805:1870607945007360:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783951308.723839:0:22805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951308.723848:0:22805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951308.723851:0:22805:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783951308.723857:0:22805:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e037ca6d800 00000020:00000080:1.0:1783951308.723860:0:22805:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783951308.723869:0:22805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951308.723871:0:22805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951308.723873:0:22805:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783951308.723875:0:22805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951308.723877:0:22805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951308.723884:0:22805:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783951308.723889:0:22805:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e037ca6d800 00000020:00000080:1.0:1783951308.723891:0:22805:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783951308.723948:0:22805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951308.723951:0:22805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951308.723953:0:22805:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1783951308.723955:0:22805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951308.723958:0:22805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951308.723960:0:22805:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783951308.723963:0:22805:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e037ca6d800 00000020:00000080:1.0:1783951308.723965:0:22805:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783951308.723994:0:22805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951308.723998:0:22805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951308.723999:0:22805:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783951308.724001:0:22805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951308.724004:0:22805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951308.724005:0:22805:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783951308.724009:0:22805:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e037ca6d800 00000020:00000080:1.0:1783951308.724010:0:22805:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783951308.724049:0:22805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b1b2cfa-7097-4258-904b-0084ac551497:22805:1870607945007488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951308.724085:0:22805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951308.724108:0:22805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348bc0780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951308.724314:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945007488 00000100:00100000:2.0:1783951308.724319:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945007488 00000100:00100000:2.0:1783951308.724346:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783951308.724352:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+11:22805:x1870607945007488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951308.726173:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+11:22805:x1870607945007488:12345-0@lo:502:llog_process_th.0 Request processed in 1814us (2081us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951308.726192:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783951308.726318:0:22805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b1b2cfa-7097-4258-904b-0084ac551497:22805:1870607945007488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783951308.726353:0:22805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951308.726359:0:22805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951308.726361:0:22805:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783951308.726364:0:22805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1783951308.729716:0:22756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783951308.729753:0:22756:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783951308.729780:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c2600/0x7645c8e1169f9a41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9a48 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.729793:0:22756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e03413c2600/0x7645c8e1169f9a41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9a48 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951308.729855:0:22756:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783951308.729858:0:22756:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e037ca6d800 10000000:01000000:0.0:1783951308.729861:0:22756:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e037ca6d800 10000000:01000000:0.0:1783951308.729865:0:22756:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783951308.729872:0:22756:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e037ca6d800 from 1 10000000:01000000:0.0:1783951308.729874:0:22756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783951308.729913:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f9a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.729921:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f9a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.729931:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f9a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951308.729955:0:22756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945007616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783951308.732290:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951308.738862:0:22756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036d3a00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951308.741548:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945007616 00000100:00100000:2.0:1783951308.741561:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945007616 00000100:00100000:2.0:1783951308.741630:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783951308.741641:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+11:22756:x1870607945007616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951308.741659:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951308.741678:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247949000/0x7645c8e1169f9a56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9a4f expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951308.741706:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247949000/0x7645c8e1169f9a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9a4f expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951308.741717:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247949000/0x7645c8e1169f9a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9a4f expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951308.741727:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247949000, rc 0) 00000100:00100000:2.0:1783951308.741800:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+12:22756:x1870607945007616:12345-0@lo:101:mount.lustre.0 Request processed in 160us (9517us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951308.741807:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783951308.747632:0:22756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945007616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951308.747662:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f9a4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9a56 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951308.747684:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f9a4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9a56 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951308.747773:0:22756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945007744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951308.747834:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951308.751778:0:22756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0348bc0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951308.754821:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945007744 00000100:00100000:2.0:1783951308.754836:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945007744 00000100:00100000:2.0:1783951308.754929:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783951308.754939:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+12:22756:x1870607945007744:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951308.755139:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+12:22756:x1870607945007744:12345-0@lo:501:mount.lustre.0 Request processed in 201us (7304us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951308.755202:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783951308.755443:0:22756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945007744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951308.755500:0:22756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945007872:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951308.755549:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951308.755589:0:22756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037cb23540 going to sleep for 11 seconds 00000100:00100000:2.0:1783951308.757385:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945007872 00000100:00100000:2.0:1783951308.757403:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945007872 00000100:00100000:2.0:1783951308.757456:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783951308.757466:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+12:22756:x1870607945007872:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951308.757630:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+12:22756:x1870607945007872:12345-0@lo:503:mount.lustre.0 Request processed in 165us (2080us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951308.757639:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783951308.757747:0:22756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945007872:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951308.758726:0:22810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b1b2cfa-7097-4258-904b-0084ac551497:22810:1870607945008000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951308.758783:0:22810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951308.758813:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945008000 00000100:00100000:2.0:1783951308.758819:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945008000 00000100:00100000:2.0:1783951308.758850:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783951308.758857:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+12:22810:x1870607945008000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951308.758950:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+12:22810:x1870607945008000:12345-0@lo:502:llog_process_th.0 Request processed in 92us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951308.758957:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783951308.759002:0:22810:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e035a104780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951308.759018:0:22810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b1b2cfa-7097-4258-904b-0084ac551497:22810:1870607945008000:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1783951308.759077:0:22810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1783951308.759093:0:22810:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e0247710000) 00000020:00000080:2.0:1783951308.759112:0:22810:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1783951308.759452:0:22810:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e037ca6d800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783951308.759457:0:22810:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e037ca6d800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783951308.759459:0:22810:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e037ca6d800 4 00010000:00080000:2.0:1783951308.759488:0:22810:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e037e5f7800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.133@tcp at head 00010000:00010000:2.0:1783951308.761071:0:22810:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1783951308.761185:0:22810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1783951308.761223:0:22810:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783951308.761238:0:22810:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7645c8e1169f9a64 00000100:00080000:2.0:1783951308.761248:0:22810:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951308.761253:0:22810:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e037e5f7800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1783951308.761283:0:22810:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e024860aa00 x1870607945008128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951308.761317:0:22810:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783951308.761517:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1870607945008128:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783951308.761594:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951308.763425:0:22810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b1b2cfa-7097-4258-904b-0084ac551497:22810:1870607945008256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951308.763497:0:22810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951308.763552:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945008256 00000100:00100000:3.0:1783951308.763559:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945008256 00000100:00100000:3.0:1783951308.765192:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783951308.765326:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945008128 00000100:00100000:2.0:1783951308.765334:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945008128 00000100:00100000:2.0:1783951308.765361:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783951308.765368:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1870607945008128:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783951308.765456:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1870607945008128:12345-0@lo:38:llog_process_th.0 Request processed in 86us (3860us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783951308.765463:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783951308.765551:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+12:22810:x1870607945008256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951308.765682:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+12:22810:x1870607945008256:12345-0@lo:502:llog_process_th.0 Request processed in 135us (2185us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951308.765689:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783951308.765775:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783951308.765784:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e037e5f7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951308.765789:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783951308.765793:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1870607945008128:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783951308.765821:0:22810:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02479066c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951308.765832:0:22810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b1b2cfa-7097-4258-904b-0084ac551497:22810:1870607945008256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951308.765884:0:22810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b1b2cfa-7097-4258-904b-0084ac551497:22810:1870607945008384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951308.765920:0:22810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951308.765947:0:22810:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02479066c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951308.772630:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945008384 00000100:00100000:2.0:1783951308.772644:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945008384 00000100:00100000:2.0:1783951308.772702:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783951308.772713:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+12:22810:x1870607945008384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951308.772899:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+12:22810:x1870607945008384:12345-0@lo:502:llog_process_th.0 Request processed in 188us (6977us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951308.772907:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783951308.773223:0:22810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b1b2cfa-7097-4258-904b-0084ac551497:22810:1870607945008384:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783951308.773257:0:22810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1783951308.777401:0:22756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783951308.777442:0:22756:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783951308.777515:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f9a4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9a56 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.777527:0:22756:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2800/0x7645c8e1169f9a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9a56 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783951308.777600:0:22756:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783951308.777603:0:22756:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783951308.777604:0:22756:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951308.777605:0:22756:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951308.777606:0:22756:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951308.777607:0:22756:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951308.777609:0:22756:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951308.777610:0:22756:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783951308.777612:0:22756:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951308.777613:0:22756:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783951308.777617:0:22756:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1783951308.777619:0:22756:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783951308.777621:0:22756:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783951308.777622:0:22756:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951308.777623:0:22756:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951308.777624:0:22756:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951308.777625:0:22756:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951308.777626:0:22756:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951308.777627:0:22756:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783951308.777628:0:22756:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951308.777629:0:22756:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783951308.777657:0:22756:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783951308.777677:0:22756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945008512:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783951308.777745:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951308.777785:0:22756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03507b3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783951308.777928:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945008512 00000100:00100000:3.0:1783951308.777936:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945008512 00000100:00100000:3.0:1783951308.778195:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783951308.778207:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+12:22756:x1870607945008512:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783951308.778234:0:22772:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783951308.778246:0:22772:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783951308.779885:0:22772:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783951308.779912:0:22772:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1783951308.781664:0:22793:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783951308.781673:0:22793:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783951308.781711:0:22793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e03427e9000/0x7645c8e1169f9a6b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951308.781730:0:22793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9a3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9a33 expref: 12 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951308.781738:0:22793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e03427e9000/0x7645c8e1169f9a6b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951308.781783:0:22793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9a3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f9a33 expref: 12 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951308.781799:0:22793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9a3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f9a33 expref: 12 pid: 22769 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951308.781830:0:22793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22793:1870607945008640:0@lo:104: 00000100:00100000:3.0:1783951308.781904:0:22793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951308.781976:0:22793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02479066c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951308.782256:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945008640 00000100:00100000:1.0:1783951308.782265:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945008640 00000100:00100000:1.0:1783951308.782318:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783951308.782328:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b1b2cfa-7097-4258-904b-0084ac551497+3:22793:x1870607945008640:12345-0@lo:104: 00010000:00010000:1.0:1783951308.782340:0:22760:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e03427e9a00/0x7645c8e1169f9a33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9a3a expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951308.782396:0:22760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783951308.782402:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b1b2cfa-7097-4258-904b-0084ac551497+3:22793:x1870607945008640:12345-0@lo:104: Request processed in 76us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951308.782408:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1783951308.782412:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951308.782418:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e03427e9a00/0x7645c8e1169f9a33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9a3a expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951308.782426:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e9a00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783951308.782430:0:22766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e03427e9a00/0x7645c8e1169f9a33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f9a3a expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951308.782446:0:22766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e03427e9a00/0x7645c8e1169f9a33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f9a3a expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951308.782453:0:22766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e03427e9a00/0x7645c8e1169f9a33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f9a3a expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951308.782459:0:22766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951308.782488:0:22766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e03427e9a00/0x7645c8e1169f9a33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9a3a expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951308.782495:0:22766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951308.782513:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e03427e9a00/0x7645c8e1169f9a33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9a3a expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951308.782519:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e03427e9a00/0x7645c8e1169f9a33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9a3a expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951308.782536:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951308.782538:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951308.782540:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951308.782616:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+12:22756:x1870607945008512:12345-0@lo:253:mount.lustre.0 Request processed in 4412us (4871us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951308.782846:0:22793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22793:1870607945008640:0@lo:104: 00010000:00010000:3.0:1783951308.782865:0:22793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e03427e9000/0x7645c8e1169f9a6b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951308.782902:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951308.782923:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b1b2cfa-7097-4258-904b-0084ac551497:3652:1870607945008768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951308.782952:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951308.784267:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945008768 00000100:00100000:0.0:1783951308.784277:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945008768 00010000:00010000:0.0:1783951308.784313:0:22762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9a3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9a33 expref: 13 pid: 22769 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951308.784343:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951308.784351:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b1b2cfa-7097-4258-904b-0084ac551497+13:3652:x1870607945008768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951308.784364:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951308.784369:0:22762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9a3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9a33 expref: 13 pid: 22769 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.784378:0:22762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9a3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f9a33 expref: 13 pid: 22769 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.784396:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9a3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f9a33 expref: 13 pid: 22769 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.784409:0:22762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e03427e9000/0x7645c8e1169f9a6b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.784417:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03427e9000/0x7645c8e1169f9a6b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783951308.784433:0:22762:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002761126s 00010000:00010000:0.0:1783951308.784437:0:22762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03427e9000/0x7645c8e1169f9a6b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.784443:0:22762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03427e9000/0x7645c8e1169f9a6b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.784451:0:22762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e03427e9000/0x7645c8e1169f9a6b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.784458:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e03427e9000/0x7645c8e1169f9a6b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.784469:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e9000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:0.0:1783951308.784474:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e03427e9000/0x7645c8e1169f9a6b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.784481:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e03427e9000/0x7645c8e1169f9a6b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.784495:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e03427e9000/0x7645c8e1169f9a6b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951308.784505:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951308.784582:0:22793:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e03427e9000/0x7645c8e1169f9a6b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951308.784591:0:22793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e03427e9000/0x7645c8e1169f9a6b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951308.784607:0:22793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03427e9000/0x7645c8e1169f9a6b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951308.786525:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b1b2cfa-7097-4258-904b-0084ac551497+12:3652:x1870607945008768:12345-0@lo:103:ldlm_bl.0 Request processed in 2166us (3563us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951308.786540:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951308.786628:0:22756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:22756:1870607945008512:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783951308.786643:0:22756:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783951308.786647:0:22756:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783951308.786649:0:22756:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783951308.786650:0:22756:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951308.786652:0:22756:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951308.786653:0:22756:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951308.786654:0:22756:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951308.786655:0:22756:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951308.786657:0:22756:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783951308.786659:0:22756:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951308.786660:0:22756:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783951308.786676:0:22756:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1783951308.789285:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b1b2cfa-7097-4258-904b-0084ac551497:3652:1870607945008768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783951308.792684:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000020:00080000:1.0:1783951308.821109:0:22756:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:1.0:1783951308.821545:0:22756:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1783951308.821629:0:22817:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:3.0:1783951308.821633:0:22817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:3.0:1783951308.821874:0:22818:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1783951308.822827:0:22818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1783951308.824525:0:22756:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1783951308.825620:0:22819:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9e037d245880 x1870607945008896/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951308.825632:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfd000 going to sleep for 0 seconds 00000040:01000000:2.0:1783951308.826091:0:22756:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1783951308.826133:0:22756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1783951308.826867:0:22756:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783951308.826877:0:22756:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1783951308.826929:0:22756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783951308.832657:0:22818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783951308.832744:0:22818:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1783951308.833403:0:22756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783951308.834068:0:22756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783951308.834122:0:22756:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1783951308.835878:0:22756:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1783951308.838044:0:22756:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1783951308.840344:0:22756:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1783951308.848988:0:22756:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783951308.849031:0:22756:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb8e800c8f988 00100000:10000000:2.0:1783951308.849039:0:22756:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1783951308.850358:0:22756:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783951308.850386:0:22756:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.133@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783951308.850414:0:22756:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1783951308.850440:0:22756:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1783951308.871321:0:22756:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783951308.873776:0:22756:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783951309.344678:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783951309.487977:0:22774:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783951309.487985:0:22774:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e037ca6d800 from 11 10000000:01000000:3.0:1783951309.487990:0:22774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783951309.488050:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03427e9000/0x7645c8e1169f9a72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951309.488062:0:22774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e03427e9000/0x7645c8e1169f9a72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951309.488074:0:22774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e03427e9000/0x7645c8e1169f9a72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951309.488102:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945009024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951309.490274:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951309.490346:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0247906480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951309.490426:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945009024 00000100:00100000:0.0:1783951309.490436:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945009024 00000100:00100000:0.0:1783951309.490484:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783951309.490504:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+11:22774:x1870607945009024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951309.490522:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951309.490540:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b2400/0x7645c8e1169f9a79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9a72 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951309.490577:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b2400/0x7645c8e1169f9a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9a72 expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951309.490589:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b2400/0x7645c8e1169f9a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9a72 expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951309.490599:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2400, rc 0) 00000100:00100000:0.0:1783951309.490656:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+12:22774:x1870607945009024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951309.490663:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783951309.490828:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945009024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951309.490846:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e03427e9000/0x7645c8e1169f9a72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9a79 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951309.490867:0:22774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e03427e9000/0x7645c8e1169f9a72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9a79 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951309.490934:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945009152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783951309.490970:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951309.491002:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0247906480 going to sleep for 11 seconds 00000100:00100000:1.0:1783951309.491935:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945009152 00000100:00100000:1.0:1783951309.491943:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945009152 00000100:00100000:1.0:1783951309.491996:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783951309.492003:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+12:22774:x1870607945009152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783951309.492023:0:22769:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783951309.492039:0:22769:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783951309.492042:0:22769:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1783951309.492135:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+12:22774:x1870607945009152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951309.492158:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783951309.492200:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945009152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783951309.492242:0:22774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783951309.492250:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03427e9000/0x7645c8e1169f9a72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9a79 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951309.492259:0:22774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e03427e9000/0x7645c8e1169f9a72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9a79 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783951309.792808:0:22812:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783951309.792817:0:22812:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951309.795330:0:22812:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783951309.795342:0:22812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1783951309.857922:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfd000 going to sleep for 0 seconds 00010000:00010000:2.0:1783951310.368280:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783951310.816862:0:22812:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783951310.816870:0:22812:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951310.816993:0:22812:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1783951310.817040:0:22812:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783951310.817205:0:22812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1783951310.880267:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfd000 going to sleep for 0 seconds 00010000:00010000:0.0:1783951311.392403:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951311.904237:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfd000 going to sleep for 0 seconds 00010000:00010000:2.0:1783951312.418334:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951312.928245:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfd000 going to sleep for 0 seconds 00000001:02000400:1.0:1783951313.070236:0:23061:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783951313.443633:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951313.954309:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfd000 going to sleep for 0 seconds 00000100:00080000:3.0:1783951314.016354:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783951314.016365:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1783951314.016369:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e0342df1000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951314.016380:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 664 00000100:00080000:3.0:1783951314.016387:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783951314.016395:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e0342df1000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951314.016426:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0342e80380 x1870607945009408/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951314.016441:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951314.016445:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783951314.016448:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951314.016451:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783951314.016454:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783951314.016471:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951314.016474:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e037e5f7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951314.016480:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e037e5f7800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951314.016497:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0342e83800 x1870607945009536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951314.016674:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b1b2cfa-7097-4258-904b-0084ac551497:3654:1870607945009280:0@lo:400:kworker.0 00000100:00100000:3.0:1783951314.016686:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945009408:0@lo:38:kworker.0 00000100:00100000:3.0:1783951314.026408:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951314.026509:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1870607945009536:0@lo:38:kworker.0 00000100:00100000:3.0:1783951314.026574:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951314.027585:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945009408 00000100:00100000:2.0:1783951314.027603:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945009408 00000100:00100000:3.0:1783951314.027644:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945009536 00000100:00100000:3.0:1783951314.027658:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945009536 00000100:00100000:2.0:1783951314.027681:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783951314.027695:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1870607945009408:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783951314.027707:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783951314.027717:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1870607945009536:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783951314.027727:0:22783:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1783951314.027750:0:22778:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 669 last 0 00000020:00000080:3.0:1783951314.027802:0:22778:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7645c8e1169f9a80 00000004:00100000:3.0:1783951314.027822:0:22778:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1783951314.027846:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1870607945009408:12345-0@lo:38:kworker.0 Request processed in 151us (1444us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951314.027856:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1783951314.027960:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0342df1000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951314.027967:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951314.027990:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945009408:0@lo:38:kworker.0 00000100:00100000:1.0:1783951314.028126:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951314.028275:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945009280 00000100:00100000:1.0:1783951314.028281:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945009280 00000100:00080000:3.0:1783951314.028332:0:22778:0:(import.c:65:import_set_state_nolock()) ffff9e035a7df000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951314.028342:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783951314.028352:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+12:3654:x1870607945009280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951314.028442:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1870607945009536:12345-0@lo:38:kworker.0 Request processed in 722us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951314.028452:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783951314.028508:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e0342e83800 x1870607945009536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783951314.028535:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1783951314.028544:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783951314.028550:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783951314.028561:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e037e5f7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783951314.028568:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3651:1870607945009536:0@lo:38:kworker.0 00000100:00100000:0.0:1783951314.042845:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b1b2cfa-7097-4258-904b-0084ac551497:3654:1870607945009280:0@lo:400:kworker.0 00000100:00100000:1.0:1783951314.047869:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+12:3654:x1870607945009280:12345-0@lo:400:kworker.0 Request processed in 19500us (19726us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951314.047890:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:00000004:0.0:1783951314.169508:0:23113:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783951314.169827:0:23113:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783951314.464826:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951314.976881:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfd000 going to sleep for 0 seconds 00000020:00000004:0.0:1783951315.279039:0:23163:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783951315.279308:0:23163:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783951315.488361:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951316.021704:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfd000 going to sleep for 0 seconds 00010000:00010000:3.0:1783951316.512617:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951317.024280:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfd000 going to sleep for 0 seconds 00010000:00010000:3.0:1783951317.536553:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951318.049117:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfd000 going to sleep for 0 seconds 00000100:00100000:3.0:1783951318.117433:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951308/real 1783951308] req@ffff9e037e426680 x1870607945006464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951318 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951318.117475:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e037e426680 x1870607945006464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951318 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951318.117496:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951308/real 1783951308] req@ffff9e037e425f80 x1870607945006336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951318 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951318.117511:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e037e425f80 x1870607945006336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951318 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783951318.117529:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e035079f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951318.117540:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783951318.117545:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945006464:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1783951318.117550:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e037e6db800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951318.117555:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783951318.117558:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945006336:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1783951318.118894:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783951318.118899:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783951318.118903:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e0342df1000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951318.118910:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 669 00000100:00080000:1.0:1783951318.118914:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783951318.118922:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e0342df1000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951318.118944:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037d245180 x1870607945009792/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951318.118962:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951318.118965:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783951318.118966:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e037e6db800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951318.118969:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 664 00000100:00080000:1.0:1783951318.118971:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783951318.118974:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e037e6db800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951318.118984:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037d247b80 x1870607945009920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951318.118990:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951318.118993:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783951318.118994:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e035079f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951318.119005:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 664 00000100:00080000:1.0:1783951318.119007:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783951318.119011:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e035079f800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951318.119022:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037d246300 x1870607945010048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951318.119058:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945009792:0@lo:38:kworker.0 00000100:00100000:1.0:1783951318.119182:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951318.119223:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945009920:0@lo:8:kworker.0 00000400:00000100:1.0:1783951318.119263:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607945009920 offset 0 length 520: 4 00000100:00100000:1.0:1783951318.119285:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945010048:0@lo:8:kworker.0 00000400:00000100:1.0:1783951318.119303:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607945010048 offset 0 length 520: 4 00000100:00100000:1.0:1783951318.119348:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607945010176:0@lo:400:kworker.0 00000100:00100000:1.0:1783951318.119388:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951318.119435:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945010176 00000100:00100000:1.0:1783951318.119443:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945010176 00000100:00100000:1.0:1783951318.119505:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783951318.119514:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607945010176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951318.119565:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607945010176:12345-0@lo:400:kworker.0 Request processed in 52us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951318.119573:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783951318.119605:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e037d244700 x1870607945010176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951318.119892:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b1b2cfa-7097-4258-904b-0084ac551497:3655:1870607945009664:0@lo:400:kworker.0 00000100:00100000:0.0:1783951318.119927:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951318.119970:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945009664 00000100:00100000:0.0:1783951318.119974:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945009664 00000100:00100000:0.0:1783951318.120001:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783951318.120008:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+12:3655:x1870607945009664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951318.120050:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+12:3655:x1870607945009664:12345-0@lo:400:kworker.0 Request processed in 43us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951318.120058:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783951318.120092:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b1b2cfa-7097-4258-904b-0084ac551497:3655:1870607945009664:0@lo:400:kworker.0 00000100:00100000:1.0:1783951318.120419:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607945010176:0@lo:400:kworker.0 00000100:00100000:2.0:1783951318.120878:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945009792 00000100:00100000:2.0:1783951318.120885:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945009792 00000100:00100000:2.0:1783951318.120908:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783951318.120914:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1870607945009792:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783951318.120932:0:22783:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951318.120986:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1870607945009792:12345-0@lo:38:kworker.0 Request processed in 71us (1804us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951318.120993:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1783951318.121226:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0342df1000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951318.121240:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951318.121244:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945009792:0@lo:38:kworker.0 00010000:00010000:2.0:1783951318.560443:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951319.078796:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfd000 going to sleep for 0 seconds 00010000:00010000:3.0:1783951319.584588:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783951320.038510:0:22812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783951320.096794:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfd000 going to sleep for 0 seconds 00010000:00010000:2.0:1783951320.612768:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951321.121419:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfd000 going to sleep for 0 seconds 00000020:01000004:3.0:1783951321.403734:0:23508:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783951321.403738:0:23508:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1783951321.403740:0:23508:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1783951321.403854:0:23508:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e0377b14000 00000020:01000004:3.0:1783951321.403870:0:23508:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1783951321.403883:0:23508:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783951321.403898:0:23508:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9e0247750000) 00000020:00000080:3.0:1783951321.403915:0:23508:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783951321.480244:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783951321.480602:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1783951321.483736:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1783951321.484075:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1783951321.484385:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1783951321.484567:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1783951321.484738:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1783951321.484951:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1783951321.485227:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1783951321.485473:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1783951321.485650:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1783951321.485817:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1783951321.486072:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1783951321.486493:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1783951321.486755:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1783951321.486939:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1783951321.487213:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1783951321.487433:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1783951321.487663:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1783951321.487872:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1783951321.488102:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1783951321.488518:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1783951321.488735:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1783951321.488914:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1783951321.489193:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1783951321.489415:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1783951321.489616:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1783951321.489802:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1783951321.490102:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1783951321.490483:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1783951321.490681:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1783951321.490909:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1783951321.491136:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1783951321.491398:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1783951321.491819:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1783951321.492017:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1783951321.492294:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1783951321.492553:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783951321.492883:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1783951321.493054:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783951321.493287:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783951321.493512:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1783951321.493711:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1783951321.493914:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1783951321.494121:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1783951321.494500:0:23508:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1783951321.495427:0:23508:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783951321.495677:0:23508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1783951321.495688:0:23508:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783951321.495699:0:23508:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7645c8e1169f9a8e 00000020:01000004:3.0:1783951321.495707:0:23508:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1783951321.495728:0:23508:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.133@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783951321.495731:0:23508:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783951321.495737:0:23508:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1783951321.495763:0:23508:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1783951321.495766:0:23508:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.133@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1783951321.499222:0:23508:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783951321.499260:0:23508:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.133@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1783951321.499265:0:23508:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783951321.499267:0:23508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783951321.499269:0:23508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951321.499270:0:23508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951321.499272:0:23508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951321.499273:0:23508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951321.499275:0:23508:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783951321.499282:0:23508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951321.499283:0:23508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783951321.499286:0:23508:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1783951321.499288:0:23508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783951321.499289:0:23508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783951321.499290:0:23508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951321.499291:0:23508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951321.499292:0:23508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951321.499293:0:23508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951321.499294:0:23508:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783951321.499295:0:23508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951321.499295:0:23508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783951321.499377:0:23508:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1783951321.499399:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945010304:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783951321.499473:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951321.499515:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037cb23540 going to sleep for 11 seconds 00000100:00100000:1.0:1783951321.499594:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945010304 00000100:00100000:1.0:1783951321.499601:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945010304 00000100:00100000:1.0:1783951321.499707:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783951321.499717:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+12:23508:x1870607945010304:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783951321.499745:0:22769:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783951321.499748:0:22769:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1783951321.499758:0:22769:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1783951321.500081:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+12:23508:x1870607945010304:12345-0@lo:253:mount.lustre.0 Request processed in 364us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951321.500090:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783951321.500197:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945010304:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783951321.500207:0:23508:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1783951321.500217:0:23508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783951321.500218:0:23508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783951321.500219:0:23508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951321.500220:0:23508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951321.500222:0:23508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951321.500223:0:23508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951321.500224:0:23508:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783951321.500225:0:23508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951321.500227:0:23508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783951321.500248:0:23508:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e0377b14000 from lustre-MDT0001 10000000:01000000:2.0:1783951321.500274:0:23508:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1783951321.500277:0:23508:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1783951321.500285:0:23508:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e037795b380 local copy 00010000:00010000:2.0:1783951321.500295:0:23508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f9984 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f998b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951321.500393:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945010432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951321.500421:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951321.500705:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03431d4180 going to sleep for 11 seconds 00000100:00100000:0.0:1783951321.500802:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945010432 00000100:00100000:0.0:1783951321.500808:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945010432 00000100:00100000:0.0:1783951321.500864:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783951321.500871:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+12:23508:x1870607945010432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951321.500945:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+12:23508:x1870607945010432:12345-0@lo:501:mount.lustre.0 Request processed in 74us (523us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783951321.500952:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783951321.501037:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945010432:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783951321.501050:0:23508:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783951321.501069:0:23508:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783951321.501075:0:23508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f9984 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f998b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.501084:0:23508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f9984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f998b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951321.501106:0:23508:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e0377b14000 10000000:01000000:2.0:1783951321.501112:0:23508:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783951321.501116:0:23508:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e037795b380 10000000:01000000:2.0:1783951321.501125:0:23508:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1783951321.501128:0:23508:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9e037795b380 from 1 10000000:01000000:2.0:1783951321.501131:0:23508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783951321.501173:0:23508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948600/0x7645c8e1169f9a95 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.501182:0:23508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247948600/0x7645c8e1169f9a95 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.501191:0:23508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247948600/0x7645c8e1169f9a95 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951321.501205:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945010560:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951321.501229:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951321.501337:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03431d4180 going to sleep for 11 seconds 00000100:00100000:1.0:1783951321.501464:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945010560 00000100:00100000:1.0:1783951321.501469:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945010560 00000100:00100000:1.0:1783951321.501490:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783951321.501496:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+12:23508:x1870607945010560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951321.501504:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951321.501517:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f9a9c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9a95 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951321.501536:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f9a9c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9a95 expref: 13 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951321.501547:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03413c3c00/0x7645c8e1169f9a9c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9a95 expref: 13 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951321.501556:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03413c3c00, rc 0) 00000100:00100000:1.0:1783951321.501598:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+13:23508:x1870607945010560:12345-0@lo:101:mount.lustre.0 Request processed in 102us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951321.501605:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783951321.501686:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945010560:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951321.501697:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247948600/0x7645c8e1169f9a95 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9a9c expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.501706:0:23508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247948600/0x7645c8e1169f9a95 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9a9c expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951321.501721:0:23508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783951321.501736:0:23508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948600/0x7645c8e1169f9a95 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9a9c expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.501744:0:23508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247948600/0x7645c8e1169f9a95 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9a9c expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951321.501752:0:23508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e0377b14000 10000000:01000000:2.0:1783951321.501760:0:23508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783951321.501764:0:23508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9e0377b14000 from 1 10000000:01000000:2.0:1783951321.501767:0:23508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783951321.501782:0:23508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949c00/0x7645c8e1169f9aa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.501788:0:23508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247949c00/0x7645c8e1169f9aa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.501796:0:23508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247949c00/0x7645c8e1169f9aa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951321.501808:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945010688:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951321.501832:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951321.501843:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03431d4180 going to sleep for 11 seconds 00000100:00100000:1.0:1783951321.501902:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945010688 00000100:00100000:1.0:1783951321.501906:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945010688 00000100:00100000:1.0:1783951321.501923:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783951321.501929:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+13:23508:x1870607945010688:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951321.501936:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951321.501945:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f9aaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9aa3 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951321.501957:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f9aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9aa3 expref: 14 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951321.501964:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03413c2400/0x7645c8e1169f9aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9aa3 expref: 14 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951321.501970:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03413c2400, rc 0) 00000100:00100000:1.0:1783951321.502006:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+14:23508:x1870607945010688:12345-0@lo:101:mount.lustre.0 Request processed in 76us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951321.502012:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783951321.502086:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945010688:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951321.502097:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247949c00/0x7645c8e1169f9aa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9aaa expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.502104:0:23508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247949c00/0x7645c8e1169f9aa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9aaa expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951321.502115:0:23508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783951321.502130:0:23508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949c00/0x7645c8e1169f9aa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9aaa expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.502137:0:23508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247949c00/0x7645c8e1169f9aa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9aaa expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951321.502163:0:23508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1783951321.502171:0:23508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783951321.502175:0:23508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e0377b14000 10000000:01000000:2.0:1783951321.502177:0:23508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783951321.502180:0:23508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1783951321.502182:0:23508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783951321.502198:0:23508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9ab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.502205:0:23508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9ab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.502212:0:23508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9ab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951321.502225:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945010816:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951321.502251:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951321.502261:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03431d4180 going to sleep for 11 seconds 00000100:00100000:1.0:1783951321.502385:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945010816 00000100:00100000:1.0:1783951321.502389:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945010816 00000100:00100000:1.0:1783951321.502407:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783951321.502412:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+14:23508:x1870607945010816:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951321.502419:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951321.502426:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f9ab8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9ab1 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951321.502449:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f9ab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9ab1 expref: 15 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951321.502469:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03413c2c00/0x7645c8e1169f9ab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9ab1 expref: 15 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951321.502477:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03413c2c00, rc 0) 00000100:00100000:1.0:1783951321.502509:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+15:23508:x1870607945010816:12345-0@lo:101:mount.lustre.0 Request processed in 97us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951321.502515:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783951321.502582:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945010816:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951321.502592:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9ab1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9ab8 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.502600:0:23508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9ab1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9ab8 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783951321.503636:0:23508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1783951321.505019:0:23508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783951321.511859:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1783951321.511930:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1783951321.511949:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1783951321.511966:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1783951321.511994:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1783951321.512013:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1783951321.512032:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1783951321.512050:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1783951321.512068:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1783951321.512083:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1783951321.512099:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1783951321.512115:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1783951321.512129:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1783951321.513106:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1783951321.513502:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1783951321.513528:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1783951321.513550:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1783951321.513568:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1783951321.513584:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1783951321.513601:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1783951321.513621:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1783951321.513641:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1783951321.513658:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1783951321.513677:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1783951321.513695:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1783951321.513712:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1783951321.513730:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1783951321.513748:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1783951321.513765:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1783951321.513780:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1783951321.513793:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1783951321.513812:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1783951321.513831:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1783951321.513849:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1783951321.513866:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1783951321.513881:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1783951321.513898:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1783951321.513948:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1783951321.513968:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1783951321.513985:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1783951321.514003:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1783951321.514020:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1783951321.514038:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1783951321.514055:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1783951321.514092:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1783951321.514099:0:23508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1783951321.515385:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945010944:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951321.515468:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951321.515567:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03431d4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783951321.521784:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945010944 00000100:00100000:1.0:1783951321.521800:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945010944 00000100:00100000:1.0:1783951321.521915:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783951321.521926:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+15:23508:x1870607945010944:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951321.522118:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+15:23508:x1870607945010944:12345-0@lo:501:mount.lustre.0 Request processed in 194us (6661us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951321.522126:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783951321.524703:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945010944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951321.524773:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945011072:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951321.524856:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951321.525309:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465da780 going to sleep for 11 seconds 00000100:00100000:3.0:1783951321.528836:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945011072 00000100:00100000:3.0:1783951321.528852:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945011072 00000100:00100000:3.0:1783951321.528924:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783951321.528935:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+15:23508:x1870607945011072:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951321.531063:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+15:23508:x1870607945011072:12345-0@lo:503:mount.lustre.0 Request processed in 2122us (6199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951321.531076:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783951321.531189:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945011072:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783951321.531691:0:23508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783951321.531771:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945011200:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951321.531833:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951321.531868:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945011200 00000100:00100000:0.0:1783951321.531874:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945011200 00000100:00100000:0.0:1783951321.531904:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783951321.531913:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+15:23508:x1870607945011200:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951321.532042:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465da780 going to sleep for 11 seconds 00000100:00100000:0.0:1783951321.532902:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+15:23508:x1870607945011200:12345-0@lo:502:mount.lustre.0 Request processed in 986us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951321.532911:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783951321.535839:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945011200:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783951321.537277:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1783951321.537351:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1783951321.537372:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1783951321.537388:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1783951321.537403:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1783951321.537419:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1783951321.537435:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1783951321.537452:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1783951321.537482:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1783951321.537514:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1783951321.537530:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1783951321.537546:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1783951321.537561:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1783951321.537575:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1783951321.537590:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1783951321.537605:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1783951321.537619:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1783951321.537633:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1783951321.537651:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1783951321.537667:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1783951321.537682:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1783951321.537696:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1783951321.537711:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1783951321.537729:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1783951321.537744:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1783951321.537758:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1783951321.537772:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1783951321.537786:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1783951321.537802:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1783951321.537819:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1783951321.537835:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1783951321.537851:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1783951321.537865:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1783951321.537880:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1783951321.537895:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1783951321.537910:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1783951321.537924:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1783951321.537938:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1783951321.537951:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1783951321.537967:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1783951321.537988:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1783951321.538006:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1783951321.538037:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1783951321.538054:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1783951321.538107:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945011328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783951321.538224:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951321.538270:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03810e1600 going to sleep for 11 seconds 00000100:00100000:0.0:1783951321.538528:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945011328 00000100:00100000:0.0:1783951321.538536:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945011328 00000100:00100000:0.0:1783951321.538582:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783951321.538592:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+15:23508:x1870607945011328:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951321.538715:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+15:23508:x1870607945011328:12345-0@lo:502:mount.lustre.0 Request processed in 124us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951321.538722:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783951321.538870:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945011328:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783951321.538932:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1783951321.538942:0:23508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1783951321.539777:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951321.539788:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951321.539791:0:23512:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1783951321.539796:0:23512:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1783951321.539800:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783951321.539814:0:23512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9e02477119c0) 00000020:00000080:2.0:1783951321.539835:0:23512:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1783951321.539840:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783951321.539927:0:23512:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783951321.539935:0:23512:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7645c8e1169f9ac6 00000020:00000080:2.0:1783951321.540292:0:23512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1783951321.540297:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951321.540371:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951321.540372:0:23512:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1783951321.540376:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951321.540380:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951321.540387:0:23512:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1783951321.540391:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783951321.540398:0:23512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9e0247713380) 00000020:00000080:2.0:1783951321.540409:0:23512:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1783951321.540413:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783951321.540415:0:23512:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1783951321.540417:0:23512:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1783951321.540423:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783951321.540475:0:23512:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0377b14000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1783951321.540487:0:23512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9e036b3099c0) 00000020:00000080:2.0:1783951321.540496:0:23512:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1783951321.540559:0:23512:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783951321.540566:0:23512:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f9adb 00000020:00000080:2.0:1783951321.540661:0:23512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1783951321.540668:0:23512:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783951321.540672:0:23512:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x7645c8e1169f9ae2 00080000:01000000:2.0:1783951321.540678:0:23512:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783951321.540681:0:23512:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7645c8e1169f9ae9 00010000:00010000:3.0:1783951321.636026:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951321.637865:0:23512:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1783951321.638536:0:23512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:1.0:1783951321.638825:0:23512:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1783951321.640282:0:23512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1783951321.640294:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951321.640357:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951321.640360:0:23512:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1783951321.640365:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951321.640371:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951321.640372:0:23512:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1783951321.640376:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783951321.640381:0:23512:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:00000080:1.0:1783951321.640413:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783951321.640469:0:23512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9e036c2e0000) 00000020:00000080:1.0:1783951321.640490:0:23512:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1783951321.640496:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783951321.640562:0:23512:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1783951321.640569:0:23512:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783951321.640577:0:23512:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7645c8e1169f9af7 00010000:00080000:1.0:1783951321.640610:0:23512:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0246ae5800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.133@tcp at head 00010000:00010000:1.0:1783951321.648880:0:23512:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1783951321.654727:0:23512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783951321.654744:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1783951321.654790:0:23512:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783951321.654815:0:23512:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f9afe 00000100:00080000:0.0:1783951321.654826:0:23512:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783951321.654833:0:23512:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e0246ae5800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783951321.654868:0:23512:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037e427800 x1870607945011456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951321.654897:0:23512:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1783951321.654959:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951321.654963:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951321.654972:0:23512:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1783951321.654976:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783951321.654979:0:23512:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1783951321.654980:0:23512:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783951321.654982:0:23512:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783951321.654984:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783951321.654986:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951321.654987:0:23512:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783951321.654990:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951321.654994:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951321.654996:0:23512:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1783951321.654999:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783951321.655030:0:23512:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1783951321.655043:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951321.655047:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951321.655048:0:23512:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1783951321.655050:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783951321.655052:0:23512:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1783951321.655053:0:23512:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783951321.655055:0:23512:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783951321.655057:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783951321.655059:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951321.655061:0:23512:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783951321.655063:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783951321.655066:0:23512:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1783951321.655070:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951321.655071:0:23512:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783951321.655074:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783951321.655090:0:23512:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:01000000:0.0:1783951321.655118:0:23512:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1783951321.655121:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783951321.655134:0:23512:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9e0351ba99c0) 00000020:00000080:0.0:1783951321.655173:0:23512:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1783951321.655179:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783951321.655257:0:23512:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1783951321.655263:0:23512:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783951321.655271:0:23512:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7645c8e1169f9b0c 00000100:00080000:3.0:1783951321.655409:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783951321.655414:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1783951321.655418:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e0342df1000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951321.655423:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 673 00000100:00080000:3.0:1783951321.655427:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783951321.655431:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e0342df1000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951321.655449:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0342e80000 x1870607945011584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951321.655470:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951321.655482:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783951321.655484:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951321.655487:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783951321.655534:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607945011712:0@lo:400:kworker.0 00000100:00100000:3.0:1783951321.655597:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951321.655658:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945011712 00000100:00100000:3.0:1783951321.655665:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945011712 00000100:00100000:3.0:1783951321.655708:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783951321.655717:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607945011712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951321.655772:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607945011712:12345-0@lo:400:kworker.0 Request processed in 54us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951321.655780:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783951321.655819:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e0342e80e00 x1870607945011712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951321.655833:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607945011712:0@lo:400:kworker.0 00010000:00080000:0.0:1783951321.655958:0:23512:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0246426000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.133@tcp at head 00000100:00100000:1.0:1783951321.656407:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945011456:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783951321.656449:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951321.656490:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945011584:0@lo:38:kworker.0 00000100:00100000:1.0:1783951321.656522:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951321.656555:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945011456 00000100:00100000:1.0:1783951321.656560:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945011456 00000100:00100000:1.0:1783951321.656575:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945011584 00000100:00100000:1.0:1783951321.656577:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945011584 00000100:00100000:1.0:1783951321.656586:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783951321.656591:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1870607945011456:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783951321.656613:0:22782:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 677 last 0 00000020:00000080:1.0:1783951321.656640:0:22782:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f9b13 00000004:00100000:1.0:1783951321.656653:0:22782:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1783951321.656659:0:22782:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:0.0:1783951321.656797:0:23512:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:1.0:1783951321.659911:0:23512:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783951321.660399:0:23512:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1783951321.662862:0:22782:0:(import.c:65:import_set_state_nolock()) ffff9e0246ae6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951321.663316:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1870607945011456:12345-0@lo:38:llog_process_th.0 Request processed in 6720us (6863us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951321.663328:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783951321.663357:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783951321.663365:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1870607945011584:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783951321.663408:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1870607945011584:12345-0@lo:38:kworker.0 Request processed in 43us (6885us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783951321.663415:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:0.0:1783951321.666713:0:23512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951321.667497:0:23512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1783951321.667657:0:23512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1783951321.669367:0:23517:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1783951321.669375:0:23517:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1783951321.670391:0:23512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783951321.670405:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783951321.670446:0:23512:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783951321.670479:0:23512:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f9b1a 00000100:00080000:0.0:1783951321.670490:0:23512:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783951321.670495:0:23512:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e0246426000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783951321.670529:0:23512:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037e424380 x1870607945011840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951321.670547:0:23512:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1783951321.670650:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951321.670654:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951321.670656:0:23512:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783951321.670660:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783951321.670662:0:23512:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1783951321.670664:0:23512:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783951321.670665:0:23512:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783951321.670666:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783951321.670668:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951321.670670:0:23512:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783951321.670672:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783951321.670676:0:23512:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1783951321.670688:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951321.670690:0:23512:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1783951321.670693:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783951321.670697:0:23512:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:01000000:0.0:1783951321.670724:0:23512:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1783951321.670727:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783951321.670738:0:23512:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9e0351bacd40) 00000020:00000080:0.0:1783951321.670751:0:23512:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1783951321.670756:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783951321.670815:0:23512:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1783951321.670822:0:23512:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783951321.670828:0:23512:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7645c8e1169f9b28 00010000:00080000:0.0:1783951321.670860:0:23512:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0246426800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.133@tcp at head 00010000:00010000:0.0:1783951321.671093:0:23512:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1783951321.671196:0:23512:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783951321.671213:0:23512:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1783951321.671598:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951321.671604:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951321.671606:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951321.671609:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783951321.673383:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783951321.673400:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1783951321.673410:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1783951321.673417:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783951321.673421:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246ae5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783951321.673448:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945011456:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783951321.673475:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783951321.673479:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0342df1000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951321.673483:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783951321.673494:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945011584:0@lo:38:kworker.0 00000100:00100000:3.0:1783951321.673527:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945011840:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783951321.673579:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607945011840 offset 0 length 520: 4 00000100:00100000:1.0:1783951321.673782:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945011968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951321.673819:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951321.673892:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945011968 00000100:00100000:3.0:1783951321.673898:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945011968 00000100:00100000:3.0:1783951321.673944:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783951321.673954:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3654:x1870607945011968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783951321.674001:0:22783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000040:00080000:0.0:1783951321.677715:0:23512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951321.677951:0:23512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1783951321.678074:0:23512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1783951321.679394:0:23519:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1783951321.679399:0:23519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783951321.680176:0:23512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783951321.680188:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783951321.680228:0:23512:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783951321.680251:0:23512:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f9b2f 00000100:00080000:0.0:1783951321.680262:0:23512:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783951321.680268:0:23512:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e0246426800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783951321.680316:0:23512:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037e425180 x1870607945012096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951321.680345:0:23512:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1783951321.680397:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951321.680401:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951321.680403:0:23512:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783951321.680406:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951321.680409:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951321.680411:0:23512:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783951321.680415:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783951321.680416:0:23512:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783951321.680418:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951321.680421:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951321.680422:0:23512:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783951321.680424:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951321.680426:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951321.680427:0:23512:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783951321.680431:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1783951321.680479:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951321.680482:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951321.680484:0:23512:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783951321.680487:0:23512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:0.0:1783951321.681831:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951321.681838:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783951321.681841:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951321.681844:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783951321.681960:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3654:x1870607945011968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8003us (8136us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951321.681975:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783951321.682017:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945012096:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783951321.682068:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607945012096 offset 0 length 520: 4 00000020:01000000:2.0:1783951321.682216:0:23508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1783951321.682255:0:23508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783951321.682280:0:23508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9ab1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9ab8 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.682291:0:23508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247948e00/0x7645c8e1169f9ab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9ab8 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951321.682310:0:23508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e0377b14000 from 1 10000000:01000000:2.0:1783951321.682313:0:23508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783951321.682346:0:23508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.682354:0:23508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.682374:0:23508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951321.682392:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945012224:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951321.682429:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951321.682449:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c300 going to sleep for 11 seconds 00000100:00100000:2.0:1783951321.682476:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945012224 00000100:00100000:2.0:1783951321.682483:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945012224 00000100:00100000:2.0:1783951321.682522:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783951321.682530:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+15:23508:x1870607945012224:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951321.682543:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951321.682555:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9b36 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.682577:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9b36 expref: 16 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.682587:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9b36 expref: 16 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.682595:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247949800, rc 0) 00000100:00100000:2.0:1783951321.682630:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+16:23508:x1870607945012224:12345-0@lo:101:mount.lustre.0 Request processed in 100us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951321.682636:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783951321.682684:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945012224:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951321.682698:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9b3d expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.682713:0:23508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9b3d expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951321.683269:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945012352:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1783951321.683310:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951321.683334:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c300 going to sleep for 11 seconds 00000100:00100000:0.0:1783951321.684435:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945012352 00000100:00100000:0.0:1783951321.684444:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945012352 00000100:00100000:0.0:1783951321.684507:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783951321.684515:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+16:23508:x1870607945012352:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1783951321.684534:0:22769:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783951321.684555:0:22769:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783951321.684558:0:22769:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1783951321.684664:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+16:23508:x1870607945012352:12345-0@lo:256:mount.lustre.0 Request processed in 149us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951321.684670:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783951321.686361:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945012352:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1783951321.686956:0:23508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783951321.686981:0:23508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9b3d expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.686994:0:23508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9b3d expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951321.687003:0:23508:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0377b14000 from 1 10000000:01000000:2.0:1783951321.687005:0:23508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783951321.687036:0:23508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9b44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.687043:0:23508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9b44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.687052:0:23508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9b44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951321.687071:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945012480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951321.687131:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951321.687342:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c300 going to sleep for 11 seconds 00000100:00100000:2.0:1783951321.687364:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945012480 00000100:00100000:2.0:1783951321.687370:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945012480 00000100:00100000:2.0:1783951321.687410:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783951321.687417:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+16:23508:x1870607945012480:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951321.687429:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951321.687440:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9b4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9b44 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.687474:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9b4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9b44 expref: 17 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.687484:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9b4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9b44 expref: 17 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.687492:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247949a00, rc 0) 00000100:00100000:2.0:1783951321.687521:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+17:23508:x1870607945012480:12345-0@lo:101:mount.lustre.0 Request processed in 104us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951321.687528:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783951321.687565:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945012480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951321.687577:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9b44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9b4b expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.687585:0:23508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9b44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9b4b expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951321.689617:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945011968:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1783951321.690844:0:23508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1783951321.691291:0:23508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783951321.691490:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1783951321.691524:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1783951321.691542:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1783951321.691576:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1783951321.691592:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1783951321.691608:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1783951321.691621:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1783951321.691634:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1783951321.691648:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1783951321.691664:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1783951321.691679:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1783951321.691700:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1783951321.691705:0:23508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1783951321.691778:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945012608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951321.691845:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951321.691878:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118c300 going to sleep for 11 seconds 00000100:00100000:3.0:1783951321.692024:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945012608 00000100:00100000:3.0:1783951321.692031:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945012608 00000100:00100000:3.0:1783951321.692092:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783951321.692103:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+17:23508:x1870607945012608:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951321.692266:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+17:23508:x1870607945012608:12345-0@lo:501:mount.lustre.0 Request processed in 164us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951321.692274:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783951321.692396:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945012608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951321.692431:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945012736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951321.692483:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951321.692502:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0247906900 going to sleep for 11 seconds 00000100:00100000:3.0:1783951321.692796:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945012736 00000100:00100000:3.0:1783951321.692802:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945012736 00000100:00100000:3.0:1783951321.692837:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783951321.692844:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+17:23508:x1870607945012736:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951321.692930:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+17:23508:x1870607945012736:12345-0@lo:503:mount.lustre.0 Request processed in 86us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951321.692942:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783951321.693035:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945012736:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783951321.693479:0:23508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783951321.693543:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945012864:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951321.693583:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951321.693603:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0247906900 going to sleep for 11 seconds 00000100:00100000:2.0:1783951321.693916:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945012864 00000100:00100000:2.0:1783951321.693922:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945012864 00000100:00100000:2.0:1783951321.693961:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783951321.693969:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+17:23508:x1870607945012864:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951321.694503:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+17:23508:x1870607945012864:12345-0@lo:502:mount.lustre.0 Request processed in 533us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951321.694511:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783951321.704886:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945012864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783951321.705280:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1783951321.705316:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1783951321.705334:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1783951321.705350:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1783951321.705366:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1783951321.705382:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1783951321.705400:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1783951321.705433:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1783951321.705450:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1783951321.705479:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1783951321.705495:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:0.0:1783951321.705536:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945012992:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951321.705606:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951321.705643:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0247906b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951321.705908:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945012992 00000100:00100000:3.0:1783951321.705915:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945012992 00000100:00100000:3.0:1783951321.705978:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783951321.705987:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+17:23508:x1870607945012992:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951321.706104:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+17:23508:x1870607945012992:12345-0@lo:502:mount.lustre.0 Request processed in 118us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951321.706112:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783951321.706281:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945012992:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783951321.706330:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1783951321.706338:0:23508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1783951321.707064:0:23521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951321.707074:0:23521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951321.707086:0:23521:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783951321.707094:0:23521:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0377b14000 00000020:00000080:1.0:1783951321.707097:0:23521:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783951321.707104:0:23521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951321.707107:0:23521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951321.707109:0:23521:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783951321.707111:0:23521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951321.707112:0:23521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951321.707114:0:23521:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783951321.707117:0:23521:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0377b14000 00000020:00000080:1.0:1783951321.707118:0:23521:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783951321.707200:0:23521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951321.707203:0:23521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951321.707204:0:23521:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1783951321.707207:0:23521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951321.707209:0:23521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951321.707210:0:23521:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783951321.707213:0:23521:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e0377b14000 00000020:00000080:1.0:1783951321.707215:0:23521:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783951321.707229:0:23521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951321.707238:0:23521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951321.707239:0:23521:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783951321.707242:0:23521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951321.707244:0:23521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951321.707245:0:23521:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783951321.707249:0:23521:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e0377b14000 00000020:00000080:1.0:1783951321.707251:0:23521:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783951321.707275:0:23521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951321.707278:0:23521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951321.707279:0:23521:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783951321.707282:0:23521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1783951321.707450:0:23508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1783951321.707490:0:23508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951321.707511:0:23508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9b44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9b4b expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951321.707522:0:23508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9b44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9b4b expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951321.707567:0:23508:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783951321.707570:0:23508:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e0377b14000 10000000:01000000:3.0:1783951321.707573:0:23508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e0377b14000 10000000:01000000:3.0:1783951321.707577:0:23508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783951321.707583:0:23508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e0377b14000 from 1 10000000:01000000:3.0:1783951321.707585:0:23508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783951321.707617:0:23508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03427e9400/0x7645c8e1169f9b52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951321.707625:0:23508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e03427e9400/0x7645c8e1169f9b52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951321.707635:0:23508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e03427e9400/0x7645c8e1169f9b52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951321.707660:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945013120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783951321.707708:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951321.707747:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037799e180 going to sleep for 11 seconds 00000100:00100000:0.0:1783951321.711236:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945013120 00000100:00100000:0.0:1783951321.711257:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945013120 00000100:00100000:0.0:1783951321.711313:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783951321.711322:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+17:23508:x1870607945013120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951321.711341:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951321.711358:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b2c00/0x7645c8e1169f9b59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9b52 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951321.711387:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b2c00/0x7645c8e1169f9b59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9b52 expref: 18 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951321.711398:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b2c00/0x7645c8e1169f9b59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9b52 expref: 18 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951321.711407:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2c00, rc 0) 00000100:00100000:0.0:1783951321.723258:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+18:23508:x1870607945013120:12345-0@lo:101:mount.lustre.0 Request processed in 11928us (15540us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951321.723272:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783951321.726326:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945013120:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951321.726359:0:23508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e03427e9400/0x7645c8e1169f9b52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9b59 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.726373:0:23508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e03427e9400/0x7645c8e1169f9b52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9b59 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783951321.738258:0:23508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1783951321.738628:0:23508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783951321.738855:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1783951321.738884:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1783951321.738901:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1783951321.738918:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1783951321.738934:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1783951321.738949:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1783951321.738966:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1783951321.738982:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1783951321.738996:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1783951321.739026:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1783951321.739044:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1783951321.739063:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1783951321.744418:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1783951321.744500:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1783951321.744522:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1783951321.744541:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1783951321.744560:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1783951321.744579:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1783951321.744594:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1783951321.744610:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1783951321.744624:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1783951321.744638:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1783951321.744654:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1783951321.744671:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1783951321.744688:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1783951321.744736:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1783951321.744754:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1783951321.744769:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1783951321.744783:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1783951321.744798:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1783951321.744813:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1783951321.744826:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1783951321.744839:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1783951321.744852:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1783951321.744867:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1783951321.744882:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1783951321.744897:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1783951321.744912:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1783951321.744928:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1783951321.744945:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1783951321.744963:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1783951321.744994:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1783951321.745014:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1783951321.745029:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1783951321.745045:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1783951321.745060:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1783951321.749216:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1783951321.749301:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1783951321.749503:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1783951321.749529:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1783951321.749550:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1783951321.749557:0:23508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1783951321.749667:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945013248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951321.749733:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951321.749800:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037799e600 going to sleep for 11 seconds 00000100:00100000:1.0:1783951321.751245:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945013248 00000100:00100000:1.0:1783951321.751258:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945013248 00000100:00100000:1.0:1783951321.751321:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783951321.751332:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+18:23508:x1870607945013248:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951321.751509:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+18:23508:x1870607945013248:12345-0@lo:501:mount.lustre.0 Request processed in 179us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951321.751519:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783951321.756679:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945013248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951321.756756:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945013376:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951321.756830:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951321.756878:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037799e600 going to sleep for 11 seconds 00000100:00100000:0.0:1783951321.759555:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945013376 00000100:00100000:0.0:1783951321.759567:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945013376 00000100:00100000:0.0:1783951321.759630:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783951321.759639:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+18:23508:x1870607945013376:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951321.759807:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+18:23508:x1870607945013376:12345-0@lo:503:mount.lustre.0 Request processed in 167us (2975us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951321.759815:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783951321.759836:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945013376:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783951321.760335:0:23508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783951321.760414:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945013504:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951321.760471:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951321.760522:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037799e600 going to sleep for 11 seconds 00000100:00100000:0.0:1783951321.761368:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945013504 00000100:00100000:0.0:1783951321.761376:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945013504 00000100:00100000:0.0:1783951321.761411:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783951321.761418:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+18:23508:x1870607945013504:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951321.761563:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+18:23508:x1870607945013504:12345-0@lo:502:mount.lustre.0 Request processed in 144us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951321.761570:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783951321.761851:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945013504:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783951321.762051:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1783951321.762441:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1783951321.762476:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1783951321.762494:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1783951321.762511:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1783951321.762525:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1783951321.762540:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1783951321.762556:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1783951321.762570:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1783951321.762581:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1783951321.762595:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1783951321.762609:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1783951321.762623:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1783951321.762638:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1783951321.762653:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1783951321.762666:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1783951321.762679:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1783951321.762707:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1783951321.762724:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1783951321.762751:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1783951321.762765:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1783951321.762781:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1783951321.762797:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1783951321.762812:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1783951321.762826:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1783951321.762840:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1783951321.762854:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1783951321.762869:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1783951321.762883:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1783951321.762899:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1783951321.762912:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1783951321.762926:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1783951321.762943:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1783951321.762972:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1783951321.762990:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1783951321.763004:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1783951321.763019:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1783951321.763035:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1783951321.763050:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1783951321.763064:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1783951321.767230:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1783951321.767301:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1783951321.767320:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1783951321.767337:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1783951321.767351:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1783951321.767365:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1783951321.767382:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1783951321.767398:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1783951321.767490:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945013632:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951321.767571:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951321.767758:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037799e600 going to sleep for 11 seconds 00000100:00100000:0.0:1783951321.771450:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945013632 00000100:00100000:0.0:1783951321.771475:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945013632 00000100:00100000:0.0:1783951321.771578:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783951321.771589:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+18:23508:x1870607945013632:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951321.771767:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+18:23508:x1870607945013632:12345-0@lo:502:mount.lustre.0 Request processed in 179us (4195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951321.771776:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783951321.771867:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945013632:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783951321.772113:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1783951321.772286:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1783951321.772325:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945013760:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951321.772371:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951321.777028:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037799e600 going to sleep for 11 seconds 00000100:00100000:2.0:1783951321.777324:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945013760 00000100:00100000:2.0:1783951321.777335:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945013760 00000100:00100000:2.0:1783951321.777385:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783951321.777396:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+18:23508:x1870607945013760:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951321.777620:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+18:23508:x1870607945013760:12345-0@lo:502:mount.lustre.0 Request processed in 225us (5248us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951321.777629:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783951321.779036:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945013760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783951321.780316:0:23508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1783951321.780339:0:23508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1783951321.788490:0:23528:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1783951321.788513:0:23528:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9e02477519c0) 00000020:00000080:3.0:1783951321.788539:0:23528:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1783951321.788739:0:23528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0377b14000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1783951321.788744:0:23528:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0377b14000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1783951321.788748:0:23528:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0377b14000 3 00010000:00080000:3.0:1783951321.788780:0:23528:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e036b55d000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.133@tcp at head 00010000:00010000:3.0:1783951321.792780:0:23528:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1783951321.792894:0:23528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1783951321.792937:0:23528:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783951321.792950:0:23528:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x7645c8e1169f9b67 00000100:00080000:3.0:1783951321.792959:0:23528:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783951321.792966:0:23528:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e036b55d000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951321.793016:0:23528:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0342e80e00 x1870607945013888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951321.793050:0:23528:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783951321.793543:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1870607945013888:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783951321.793607:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783951321.795192:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951321.795202:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783951321.795204:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951321.795208:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783951321.795294:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945013888 00000100:00100000:3.0:1783951321.795303:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945013888 00000100:00100000:3.0:1783951321.795360:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783951321.795368:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1870607945013888:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783951321.795397:0:22776:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 677 last 0 00000020:00000080:3.0:1783951321.795435:0:22776:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x7645c8e1169f9b6e 00000004:00100000:3.0:1783951321.795450:0:22776:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783951321.795581:0:22776:0:(import.c:65:import_set_state_nolock()) ffff9e036b559800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951321.795718:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1870607945013888:12345-0@lo:38:llog_process_th.0 Request processed in 349us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951321.795726:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1783951321.795846:0:23528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1783951321.796727:0:23508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783951321.796761:0:23508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783951321.796787:0:23508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03427e9400/0x7645c8e1169f9b52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9b59 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.796798:0:23508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e03427e9400/0x7645c8e1169f9b52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9b59 expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783951321.796855:0:23508:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783951321.796858:0:23508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783951321.796859:0:23508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951321.796860:0:23508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951321.796862:0:23508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951321.796863:0:23508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951321.796865:0:23508:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783951321.796867:0:23508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951321.796868:0:23508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783951321.796873:0:23508:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1783951321.796875:0:23508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783951321.796876:0:23508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783951321.796883:0:23508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951321.796884:0:23508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951321.796884:0:23508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951321.796886:0:23508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951321.796886:0:23508:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783951321.796888:0:23508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951321.796888:0:23508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783951321.796913:0:23508:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1783951321.796931:0:23508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945014016:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783951321.800072:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951321.800276:0:23508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e416480 going to sleep for 11 seconds 00000100:00100000:1.0:1783951321.800355:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945014016 00000100:00100000:1.0:1783951321.800366:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945014016 00000100:00100000:1.0:1783951321.801055:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783951321.801069:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+18:23508:x1870607945014016:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783951321.801104:0:22772:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1783951321.801117:0:22772:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1783951321.802808:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e0342e80e00 x1870607945013888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951321.802823:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783951321.802835:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1783951321.802844:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783951321.802850:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783951321.802854:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e036b55d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783951321.802860:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3651:1870607945013888:0@lo:38:llog_process_th.0 00000001:00100000:0.0:1783951321.806658:0:22757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1783951321.806744:0:22772:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783951321.806756:0:22772:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1783951321.806997:0:22793:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783951321.807002:0:22793:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783951321.807021:0:22793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e03427e8400/0x7645c8e1169f9b75 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951321.807040:0:22793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e037d2b2400/0x7645c8e1169f9a79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9a72 expref: 18 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951321.807048:0:22793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9b36 expref: 18 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951321.807056:0:22793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e03427e8400/0x7645c8e1169f9b75 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951321.807109:0:22793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f9b36 expref: 18 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951321.807165:0:22793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f9b36 expref: 18 pid: 22771 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951321.807192:0:22793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e83100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22793:1870607945014144:0@lo:104: 00000100:00100000:3.0:1783951321.807250:0:22793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783951321.807304:0:22793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e037d2b2400/0x7645c8e1169f9a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f9a72 expref: 18 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951321.807312:0:22793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e037d2b2400/0x7645c8e1169f9a79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f9a72 expref: 18 pid: 22771 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951321.807320:0:22793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22793:1870607945014272:0@lo:104: 00000100:00100000:3.0:1783951321.807340:0:22793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951321.807361:0:22793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037799e600 going to sleep for 11 seconds 00000100:00100000:0.0:1783951321.807438:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945014144 00000100:00100000:0.0:1783951321.807458:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945014144 00000100:00100000:0.0:1783951321.807491:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945014272 00000100:00100000:0.0:1783951321.807494:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945014272 00000100:00100000:0.0:1783951321.807507:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783951321.807516:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b1b2cfa-7097-4258-904b-0084ac551497+4:22793:x1870607945014144:12345-0@lo:104: 00010000:00010000:0.0:1783951321.807528:0:22761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9b3d expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951321.807589:0:22761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783951321.807596:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b1b2cfa-7097-4258-904b-0084ac551497+4:22793:x1870607945014144:12345-0@lo:104: Request processed in 81us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951321.807603:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783951321.807616:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+18:23508:x1870607945014016:12345-0@lo:253:mount.lustre.0 Request processed in 6550us (8540us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951321.807618:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783951321.807624:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783951321.807624:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b1b2cfa-7097-4258-904b-0084ac551497+3:22793:x1870607945014272:12345-0@lo:104: 00010000:00010000:0.0:1783951321.807631:0:22761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e03427e9000/0x7645c8e1169f9a72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9a79 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.807651:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951321.807657:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9b3d expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951321.807658:0:22761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783951321.807662:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b1b2cfa-7097-4258-904b-0084ac551497+3:22793:x1870607945014272:12345-0@lo:104: Request processed in 39us (322us total) trans 0 rc 0/0 00010000:00010000:2.0:1783951321.807664:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949e00 already unused, calling callback (ffffffffc1466c20) 00000100:00100000:0.0:1783951321.807668:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:00010000:2.0:1783951321.807669:0:22766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f9b3d expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.807678:0:22766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f9b3d expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951321.807685:0:22766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f9b3d expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951321.807692:0:22766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951321.807726:0:22766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9b3d expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.807733:0:22766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951321.807762:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9b3d expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.807770:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9b3d expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.807781:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951321.807784:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e03427e9000/0x7645c8e1169f9a72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9a79 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.807790:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e9000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783951321.807793:0:22766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e03427e9000/0x7645c8e1169f9a72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f9a79 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951321.807798:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b1b2cfa-7097-4258-904b-0084ac551497:3655:1870607945014400:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783951321.807799:0:22766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e03427e9000/0x7645c8e1169f9a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f9a79 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951321.807805:0:22766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e03427e9000/0x7645c8e1169f9a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f9a79 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951321.807810:0:22766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1783951321.807828:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783951321.807832:0:22766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e03427e9000/0x7645c8e1169f9a72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9a79 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.807837:0:22766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951321.807848:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e03427e9000/0x7645c8e1169f9a72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9a79 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951321.807854:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e03427e9000/0x7645c8e1169f9a72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9a79 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951321.807867:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945014400 00000100:00100000:1.0:1783951321.807875:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945014400 00010000:00010000:2.0:1783951321.807876:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951321.807878:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951321.807879:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951321.807892:0:22762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b3d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9b36 expref: 18 pid: 22771 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951321.807906:0:23508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:23508:1870607945014016:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783951321.807911:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783951321.807916:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d247100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b1b2cfa-7097-4258-904b-0084ac551497+18:3655:x1870607945014400:12345-0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1783951321.807917:0:23508:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1783951321.807920:0:23508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783951321.807922:0:23508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783951321.807923:0:23508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951321.807924:0:23508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00010000:00010000:1.0:1783951321.807924:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:01000004:2.0:1783951321.807926:0:23508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951321.807927:0:23508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00010000:00010000:1.0:1783951321.807928:0:22762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b3d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9b36 expref: 18 pid: 22771 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783951321.807929:0:23508:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783951321.807931:0:23508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951321.807932:0:23508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1783951321.807937:0:22762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f9b36 expref: 18 pid: 22771 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:2.0:1783951321.807946:0:23508:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1783951321.807950:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951321.807975:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d247100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b1b2cfa-7097-4258-904b-0084ac551497+18:3655:x1870607945014400:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951321.807981:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783951321.808005:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b1b2cfa-7097-4258-904b-0084ac551497:3655:1870607945014400:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951321.809190:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951321.809205:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b1b2cfa-7097-4258-904b-0084ac551497:3652:1870607945014528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951321.809239:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783951321.809310:0:22793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f9b36 expref: 17 pid: 22771 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951321.809320:0:22793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e83100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22793:1870607945014144:0@lo:104: 00000100:00100000:3.0:1783951321.809332:0:22793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22793:1870607945014272:0@lo:104: 00010000:00010000:3.0:1783951321.809348:0:22793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e03427e8400/0x7645c8e1169f9b75 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951321.809434:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945014528 00000100:00100000:0.0:1783951321.809440:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945014528 00010000:00010000:0.0:1783951321.809469:0:22764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e037d2b2400/0x7645c8e1169f9a79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9a72 expref: 17 pid: 22771 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951321.809499:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783951321.809507:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b1b2cfa-7097-4258-904b-0084ac551497+17:3652:x1870607945014528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951321.809517:0:22764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951321.809528:0:22764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e037d2b2400/0x7645c8e1169f9a79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9a72 expref: 17 pid: 22771 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951321.809538:0:22764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e037d2b2400/0x7645c8e1169f9a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f9a72 expref: 17 pid: 22771 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951321.809550:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b2400/0x7645c8e1169f9a79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f9a72 expref: 17 pid: 22771 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951321.809562:0:22764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e03427e8400/0x7645c8e1169f9b75 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951321.809571:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03427e8400/0x7645c8e1169f9b75 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783951321.809584:0:22764:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002761126s 00010000:00010000:0.0:1783951321.809588:0:22764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03427e8400/0x7645c8e1169f9b75 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951321.809595:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03427e8400/0x7645c8e1169f9b75 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951321.809601:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e03427e8400/0x7645c8e1169f9b75 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951321.809608:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e03427e8400/0x7645c8e1169f9b75 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951321.809615:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e8400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:0.0:1783951321.809618:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e03427e8400/0x7645c8e1169f9b75 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951321.809636:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e03427e8400/0x7645c8e1169f9b75 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951321.809656:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e03427e8400/0x7645c8e1169f9b75 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951321.809665:0:22764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951321.809706:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b1b2cfa-7097-4258-904b-0084ac551497+16:3652:x1870607945014528:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951321.809712:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783951321.813664:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b1b2cfa-7097-4258-904b-0084ac551497:3652:1870607945014528:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951321.813901:0:22793:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e03427e8400/0x7645c8e1169f9b75 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951321.813915:0:22793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e03427e8400/0x7645c8e1169f9b75 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951321.813941:0:22793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03427e8400/0x7645c8e1169f9b75 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:0.0:1783951321.817460:0:23508:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1783951321.817528:0:23532:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1783951321.817533:0:23532:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1783951321.817732:0:23533:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783951321.817883:0:23508:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1783951321.821598:0:23534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23534:1870607945014656:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1783951321.821630:0:23508:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:3.0:1783951321.821669:0:23534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1783951321.821670:0:23508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783951321.821721:0:23534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342e2fb40 going to sleep for 11 seconds 00000004:00000080:0.0:1783951321.822096:0:23508:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783951321.822103:0:23508:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1783951321.822183:0:23508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783951321.822299:0:23533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783951321.822476:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945014656 00000100:00100000:1.0:1783951321.822483:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945014656 00000100:00100000:1.0:1783951321.822530:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783951321.822538:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23534:x1870607945014656:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783951321.822621:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23534:x1870607945014656:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 82us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951321.822628:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783951321.825299:0:23534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23534:1870607945014656:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1783951321.825357:0:23534:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783951321.825406:0:23534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23534:1870607945014784:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783951321.825477:0:23534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951321.825529:0:23534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03485ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1783951321.825548:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945014784 00000100:00100000:1.0:1783951321.825554:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945014784 00000100:00100000:1.0:1783951321.825607:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783951321.825615:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23534:x1870607945014784:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783951321.825783:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23534:x1870607945014784:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 168us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951321.825791:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783951321.825882:0:23534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23534:1870607945014784:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783951321.825940:0:23534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23534:1870607945014912:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1783951321.825967:0:23534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951321.826001:0:23534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03485caf00 going to sleep for 11 seconds 00000040:00080000:2.0:1783951321.826558:0:23533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783951321.826624:0:23533:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1783951321.826771:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945014912 00000100:00100000:1.0:1783951321.826777:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945014912 00000100:00100000:1.0:1783951321.826815:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783951321.826822:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23534:x1870607945014912:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1783951321.826879:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23534:x1870607945014912:12345-0@lo:900:lod0001_rec0000.0 Request processed in 56us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951321.826885:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783951321.826919:0:23534:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e0342e82d80 x1870607945014912/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783951337 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951321.826931:0:23534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23534:1870607945014912:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1783951321.826977:0:23534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23534:1870607945015040:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783951321.827021:0:23534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951321.827057:0:23534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03485ca300 going to sleep for 11 seconds 00000100:00100000:2.0:1783951321.827508:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945015040 00000040:00080000:0.0:1783951321.827508:0:23508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1783951321.827512:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945015040 00000100:00100000:2.0:1783951321.827544:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783951321.827551:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23534:x1870607945015040:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1783951321.827629:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23534:x1870607945015040:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 78us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951321.827636:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783951321.827681:0:23534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23534:1870607945015040:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1783951321.827730:0:23534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783951321.829654:0:23508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783951321.829716:0:23508:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1783951321.829907:0:23508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1783951321.830658:0:23508:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:1.0:1783951321.836560:0:23534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783951321.836645:0:23534:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783951321.836651:0:23534:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1783951321.849628:0:23508:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1783951321.857504:0:23508:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783951321.857555:0:23508:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb8e8017eb988 00100000:10000000:2.0:1783951321.857564:0:23508:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1783951321.857970:0:23508:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783951321.858015:0:23508:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.133@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783951321.858034:0:23508:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783951321.858049:0:23508:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1783951321.858870:0:23508:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783951321.859427:0:23508:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1783951322.149736:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfd000 going to sleep for 0 seconds 00010000:00010000:2.0:1783951322.660350:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783951322.790427:0:23527:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1783951323.042308:0:22774:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783951323.042317:0:22774:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e0377b14000 from 12 10000000:01000000:1.0:1783951323.042323:0:22774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783951323.042380:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9b7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951323.042393:0:22774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9b7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951323.042406:0:22774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9b7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951323.042433:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d245500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945015168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951323.042515:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951323.042796:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945015168 00000100:00100000:2.0:1783951323.042806:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945015168 00000100:00100000:2.0:1783951323.042873:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783951323.042883:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+16:22774:x1870607945015168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951323.042897:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951323.042912:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247949400/0x7645c8e1169f9b83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9b7c expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951323.042936:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247949400/0x7645c8e1169f9b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9b7c expref: 17 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951323.042947:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247949400/0x7645c8e1169f9b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9b7c expref: 17 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951323.042956:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247949400, rc 0) 00000100:00100000:2.0:1783951323.042990:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+17:22774:x1870607945015168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951323.042996:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783951323.043061:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03429850c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951323.043084:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d245500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945015168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951323.043098:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9b7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9b83 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951323.043106:0:22774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9b7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9b83 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951323.043175:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d245500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945015296:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783951323.043385:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951323.043406:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03429850c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951323.043538:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945015296 00000100:00100000:2.0:1783951323.043543:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945015296 00000100:00100000:2.0:1783951323.043654:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783951323.043662:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+17:22774:x1870607945015296:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783951323.043684:0:22772:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783951323.043699:0:22772:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783951323.043702:0:22772:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1783951323.044738:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+17:22774:x1870607945015296:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1072us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951323.044749:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783951323.044801:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d245500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945015296:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783951323.044848:0:22774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783951323.044858:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9b7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9b83 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951323.044867:0:22774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9b7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9b83 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951323.044877:0:22774:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783951323.044879:0:22774:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e037ca6d800 from 12 10000000:01000000:2.0:1783951323.044882:0:22774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783951323.044905:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951323.044912:0:22774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951323.044920:0:22774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951323.044936:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945015424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783951323.044962:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951323.044996:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246ad4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951323.045012:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945015424 00000100:00100000:2.0:1783951323.045017:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945015424 00000100:00100000:2.0:1783951323.045045:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783951323.045052:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+17:22774:x1870607945015424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951323.045062:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951323.045073:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9b8a expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951323.045092:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9b8a expref: 18 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951323.045102:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9b8a expref: 18 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951323.045110:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247949800, rc 0) 00000100:00100000:2.0:1783951323.045137:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+18:22774:x1870607945015424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951323.045159:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783951323.046848:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945015424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951323.046874:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9b91 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951323.046887:0:22774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9b91 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951323.046951:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945015552:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783951323.047008:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951323.047091:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246ad4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951323.048301:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945015552 00000100:00100000:3.0:1783951323.048312:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945015552 00000100:00100000:3.0:1783951323.048412:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783951323.048423:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+18:22774:x1870607945015552:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783951323.048458:0:22772:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783951323.048478:0:22772:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783951323.048481:0:22772:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1783951323.048617:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+18:22774:x1870607945015552:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 195us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951323.048625:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783951323.048703:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945015552:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783951323.048762:0:22774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783951323.048771:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9b91 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951323.048782:0:22774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9b91 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951323.171707:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfd000 going to sleep for 0 seconds 00010000:00010000:0.0:1783951323.680739:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783951323.813746:0:23527:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783951324.192356:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfd000 going to sleep for 0 seconds 00010000:00010000:2.0:1783951324.704744:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951325.216419:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfd000 going to sleep for 0 seconds 00010000:00010000:0.0:1783951325.728440:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951326.240366:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfd000 going to sleep for 0 seconds 00010000:00010000:2.0:1783951326.759318:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783951326.816443:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783951326.816450:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783951326.816454:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e0342df1000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951326.816474:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e0342df1000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951326.816498:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037d247480 x1870607945015808/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951326.816529:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951326.816533:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951326.816536:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951326.816539:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951326.816568:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951326.816571:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951326.816573:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951326.816576:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783951326.816607:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607945016192:0@lo:400:kworker.0 00000100:00100000:1.0:1783951326.816676:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951326.816718:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951326.816724:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b1b2cfa-7097-4258-904b-0084ac551497:3652:1870607945015680:0@lo:400:kworker.0 00000100:00100000:1.0:1783951326.816753:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951326.816789:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607945015936:0@lo:400:kworker.0 00000100:00100000:1.0:1783951326.816811:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951326.816829:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951326.816834:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945016064:0@lo:400:kworker.0 00000100:00100000:1.0:1783951326.816858:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951326.816892:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945016192 00000100:00100000:1.0:1783951326.816899:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945016192 00000100:00100000:1.0:1783951326.816947:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945015936 00000100:00100000:1.0:1783951326.816951:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945015936 00000100:00100000:1.0:1783951326.816968:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951326.816976:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607945016192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951326.817028:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607945016192:12345-0@lo:400:kworker.0 Request processed in 52us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951326.817036:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951326.817052:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783951326.817058:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607945015936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951326.817090:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607945015936:12345-0@lo:400:kworker.0 Request processed in 32us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951326.817095:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783951326.817114:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945015680 00000100:00100000:1.0:1783951326.817118:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945015680 00000100:00100000:1.0:1783951326.817166:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783951326.817173:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+18:3652:x1870607945015680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951326.817201:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+18:3652:x1870607945015680:12345-0@lo:400:kworker.0 Request processed in 29us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951326.817206:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783951326.817236:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945016064 00000100:00100000:1.0:1783951326.817240:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945016064 00000100:00100000:1.0:1783951326.817260:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783951326.817266:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945016064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951326.817504:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945015808:0@lo:38:kworker.0 00000100:00100000:0.0:1783951326.817549:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951326.818431:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945016320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783951326.818471:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951326.818617:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945016064:12345-0@lo:400:kworker.0 Request processed in 28us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951326.818626:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783951326.818643:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945015808 00000100:00100000:1.0:1783951326.818654:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945015808 00000100:00100000:1.0:1783951326.818668:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945016320 00000100:00100000:1.0:1783951326.818670:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945016320 00000100:00100000:1.0:1783951326.818686:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783951326.818691:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1870607945015808:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783951326.818729:0:22782:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 682 last 0 00000020:00000080:1.0:1783951326.818770:0:22782:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f9b98 00000004:00100000:1.0:1783951326.818784:0:22782:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1783951326.818790:0:22782:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1783951326.818897:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945016064:0@lo:400:kworker.0 00010000:00080000:1.0:1783951326.818913:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e037d246680 x1870607945015936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951326.818923:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607945015936:0@lo:400:kworker.0 00000100:00100000:1.0:1783951326.818956:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b1b2cfa-7097-4258-904b-0084ac551497:3652:1870607945015680:0@lo:400:kworker.0 00010000:00080000:1.0:1783951326.818968:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e037d247800 x1870607945016192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951326.818977:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607945016192:0@lo:400:kworker.0 00000100:00080000:2.0:1783951326.827065:0:22782:0:(import.c:65:import_set_state_nolock()) ffff9e0247709800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951326.827195:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1870607945015808:12345-0@lo:38:kworker.0 Request processed in 8500us (9643us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951326.827208:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783951326.827239:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783951326.827369:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945016320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783951326.827402:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783951326.827457:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945016320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 210us (8985us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951326.827465:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1783951326.827514:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1783951326.827524:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783951326.827530:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783951326.827534:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0342df1000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1783951326.827552:0:3651:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000932c5c43): req@ffff9e037d245880 x1870607945008896/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951326.827571:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945015808:0@lo:38:kworker.0 00000100:00100000:3.0:1783951326.827791:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945016320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951326.828090:0:22819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951326.828121:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342dfd000 going to sleep for 11 seconds 00000100:00100000:3.0:1783951326.828676:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945008896 00000100:00100000:3.0:1783951326.828683:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945008896 00000100:00100000:3.0:1783951326.828724:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783951326.828731:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22819:x1870607945008896:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783951326.828813:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22819:x1870607945008896:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 81us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951326.828820:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783951326.828852:0:22819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d245880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22819:1870607945008896:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1783951326.828904:0:22819:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783951326.828953:0:22819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e83800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22819:1870607945016448:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783951326.828985:0:22819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951326.829009:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02479063c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951326.829020:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945016448 00000100:00100000:3.0:1783951326.829023:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945016448 00000100:00100000:3.0:1783951326.829044:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783951326.829050:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22819:x1870607945016448:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783951326.829165:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22819:x1870607945016448:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 114us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951326.829172:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783951326.829196:0:22819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e83800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22819:1870607945016448:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783951326.829254:0:22819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e83800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22819:1870607945016576:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783951326.829277:0:22819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951326.831399:0:22819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e02479063c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951326.831445:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945016576 00000100:00100000:3.0:1783951326.831453:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945016576 00000100:00100000:3.0:1783951326.831504:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783951326.831513:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22819:x1870607945016576:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783951326.831745:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945016704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951326.831806:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951326.831976:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22819:x1870607945016576:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 463us (2697us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951326.831983:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783951326.831998:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945016704 00000100:00100000:3.0:1783951326.832001:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945016704 00000100:00100000:3.0:1783951326.832016:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783951326.832021:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1870607945016704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783951326.832045:0:22783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783951326.832104:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1870607945016704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951326.832110:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783951326.832168:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945016704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951326.832252:0:22819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e83800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22819:1870607945016576:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1783951326.832391:0:22819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951326.839779:0:22819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783951326.840958:0:22819:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:0.0:1783951326.840968:0:22819:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:1.0:1783951326.901762:0:23777:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783951327.782430:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783951327.856970:0:23829:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783951327.857367:0:23829:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1783951328.711892:0:23879:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783951328.712761:0:23879:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783951328.800293:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783951329.724234:0:23927:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4b4fb900 20000000:00000080:0.0:1783951329.724252:0:23927:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e036b482c00 uarg=0000000000000000 20000000:01000000:0.0:1783951329.724292:0:23927:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1783951329.724299:0:23927:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1783951329.724304:0:23927:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1783951329.727327:0:23928:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1783951329.727604:0:23927:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783951329.738389:0:23927:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783951329.740940:0:23927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e03413c2000/0x7645c8e1169f9b9f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951329.740964:0:23927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9a48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9a41 expref: 17 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951329.740991:0:23927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9b4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9b44 expref: 17 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951329.740998:0:23927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e03413c2000/0x7645c8e1169f9b9f lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951329.741042:0:23927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9b4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f9b44 expref: 17 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951329.741058:0:23927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9b4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f9b44 expref: 17 pid: 22772 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951329.741074:0:23927:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23927:1870607945016832:0@lo:104: 00000100:00100000:1.0:1783951329.741163:0:23927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951329.741215:0:23927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9a48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f9a41 expref: 17 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951329.741223:0:23927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9a48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f9a41 expref: 17 pid: 22772 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951329.741231:0:23927:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23927:1870607945016960:0@lo:104: 00000100:00100000:1.0:1783951329.741251:0:23927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951329.741270:0:23927:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0344c31c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783951329.741350:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945016832 00000100:00100000:2.0:1783951329.741358:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945016832 00000100:00100000:2.0:1783951329.741413:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945016960 00000100:00100000:2.0:1783951329.741417:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945016960 00000100:00100000:2.0:1783951329.741437:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783951329.741444:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b1b2cfa-7097-4258-904b-0084ac551497+4:23927:x1870607945016832:12345-0@lo:104: 00010000:00010000:2.0:1783951329.741455:0:22760:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9b44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9b4b expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.741515:0:22760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783951329.741520:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b1b2cfa-7097-4258-904b-0084ac551497+4:23927:x1870607945016832:12345-0@lo:104: Request processed in 77us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951329.741527:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783951329.741543:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783951329.741548:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d245880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b1b2cfa-7097-4258-904b-0084ac551497+3:23927:x1870607945016960:12345-0@lo:104: 00010000:00010000:2.0:1783951329.741555:0:22760:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e03413c2600/0x7645c8e1169f9a41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9a48 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.741581:0:22760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783951329.741586:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d245880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b1b2cfa-7097-4258-904b-0084ac551497+3:23927:x1870607945016960:12345-0@lo:104: Request processed in 39us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951329.741592:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1783951329.741604:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783951329.741610:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9b44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9b4b expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.741618:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949200 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783951329.741622:0:22766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9b44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f9b4b expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.741631:0:22766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9b44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f9b4b expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951329.741648:0:22766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9b44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f9b4b expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951329.741654:0:22766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783951329.741679:0:22766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9b44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9b4b expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.741685:0:22766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951329.741701:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9b44 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9b4b expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.741708:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9b44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9b4b expref: -99 pid: 23508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.741720:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951329.741723:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e03413c2600/0x7645c8e1169f9a41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9a48 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.741729:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c2600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783951329.741732:0:22766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c2600/0x7645c8e1169f9a41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f9a48 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.741739:0:22766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e03413c2600/0x7645c8e1169f9a41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f9a48 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951329.741745:0:22766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c2600/0x7645c8e1169f9a41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f9a48 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951329.741750:0:22766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783951329.741763:0:22766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e03413c2600/0x7645c8e1169f9a41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9a48 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.741769:0:22766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951329.741781:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e03413c2600/0x7645c8e1169f9a41 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9a48 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.741799:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e03413c2600/0x7645c8e1169f9a41 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9a48 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.741812:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951329.741814:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951329.741816:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951329.741831:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b1b2cfa-7097-4258-904b-0084ac551497:3652:1870607945017216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783951329.741856:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951329.741886:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945017216 00000100:00100000:2.0:1783951329.741889:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945017216 00010000:00010000:2.0:1783951329.741902:0:22762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9a48 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9a41 expref: 18 pid: 22772 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951329.741919:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783951329.741924:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b1b2cfa-7097-4258-904b-0084ac551497+18:3652:x1870607945017216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783951329.741932:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951329.741936:0:22762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9a48 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9a41 expref: 18 pid: 22772 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.741946:0:22762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9a48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f9a41 expref: 18 pid: 22772 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.741960:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951329.741990:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b1b2cfa-7097-4258-904b-0084ac551497+18:3652:x1870607945017216:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951329.741996:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783951329.742025:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b1b2cfa-7097-4258-904b-0084ac551497:3652:1870607945017216:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951329.742175:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951329.742183:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951329.742193:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b1b2cfa-7097-4258-904b-0084ac551497:3654:1870607945017088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951329.742220:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951329.742412:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945017088 00000100:00100000:2.0:1783951329.742415:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945017088 00010000:00010000:2.0:1783951329.742429:0:22763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9b4b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9b44 expref: 18 pid: 22772 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951329.742447:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783951329.742452:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b1b2cfa-7097-4258-904b-0084ac551497+18:3654:x1870607945017088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783951329.742459:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951329.742462:0:22763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9b4b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9b44 expref: 18 pid: 22772 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.742471:0:22763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9b4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f9b44 expref: 18 pid: 22772 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.742484:0:22763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e03413c2000/0x7645c8e1169f9b9f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.742492:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03413c2000/0x7645c8e1169f9b9f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.742503:0:22763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03413c2000/0x7645c8e1169f9b9f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.742510:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e03413c2000/0x7645c8e1169f9b9f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.742517:0:22763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e03413c2000/0x7645c8e1169f9b9f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.742529:0:22763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e03413c2000/0x7645c8e1169f9b9f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.742535:0:22763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c2000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951329.742539:0:22763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e03413c2000/0x7645c8e1169f9b9f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.742546:0:22763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e03413c2000/0x7645c8e1169f9b9f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.742554:0:22763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e03413c2000/0x7645c8e1169f9b9f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.742562:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951329.742584:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b1b2cfa-7097-4258-904b-0084ac551497+18:3654:x1870607945017088:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951329.742590:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783951329.742657:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b1b2cfa-7097-4258-904b-0084ac551497:3654:1870607945017088:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951329.742754:0:23927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9b4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f9b44 expref: 17 pid: 22772 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951329.742766:0:23927:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23927:1870607945016832:0@lo:104: 00010000:00010000:1.0:1783951329.742775:0:23927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9a48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f9a41 expref: 16 pid: 22772 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951329.742804:0:23927:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23927:1870607945016960:0@lo:104: 00010000:00010000:1.0:1783951329.742818:0:23927:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e03413c2000/0x7645c8e1169f9b9f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951329.742827:0:23927:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e03413c2000/0x7645c8e1169f9b9f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951329.742833:0:23927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e03413c2000/0x7645c8e1169f9b9f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951329.742840:0:23927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03413c2000/0x7645c8e1169f9b9f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951329.825274:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783951330.273640:0:22812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783951330.849525:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783951331.624590:0:22774:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783951331.624598:0:22774:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0377b14000 from 13 10000000:01000000:3.0:1783951331.624604:0:22774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951331.624658:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03427e8400/0x7645c8e1169f9ba6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951331.624671:0:22774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e03427e8400/0x7645c8e1169f9ba6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951331.624682:0:22774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e03427e8400/0x7645c8e1169f9ba6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951331.624710:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945017344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951331.624782:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951331.624867:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d88e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951331.625291:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945017344 00000100:00100000:2.0:1783951331.625299:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945017344 00000100:00100000:2.0:1783951331.627454:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783951331.627478:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+16:22774:x1870607945017344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951331.627501:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951331.627527:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247949600/0x7645c8e1169f9bad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9ba6 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951331.627561:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247949600/0x7645c8e1169f9bad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9ba6 expref: 17 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951331.627595:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247949600/0x7645c8e1169f9bad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9ba6 expref: 17 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951331.627605:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247949600, rc 0) 00000100:00100000:2.0:1783951331.627689:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+17:22774:x1870607945017344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (2906us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951331.627696:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783951331.628752:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945017344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951331.628777:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e03427e8400/0x7645c8e1169f9ba6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9bad expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951331.628805:0:22774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e03427e8400/0x7645c8e1169f9ba6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9bad expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951331.628892:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945017472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951331.628939:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951331.628976:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d88e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951331.629036:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945017472 00000100:00100000:2.0:1783951331.629042:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945017472 00000100:00100000:2.0:1783951331.629079:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783951331.629087:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+17:22774:x1870607945017472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951331.629317:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+17:22774:x1870607945017472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951331.629325:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783951331.629376:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945017472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951331.629406:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945017600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951331.629452:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951331.629480:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d88e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951331.630054:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945017600 00000100:00100000:2.0:1783951331.630060:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945017600 00000100:00100000:2.0:1783951331.630098:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783951331.630105:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+17:22774:x1870607945017600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951331.630478:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+17:22774:x1870607945017600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 372us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951331.630485:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783951331.631562:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945017600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783951331.633619:0:23999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1783951331.633810:0:22774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1783951331.633836:0:22774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951331.633849:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03427e8400/0x7645c8e1169f9ba6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9bad expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951331.633861:0:22774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e03427e8400/0x7645c8e1169f9ba6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9bad expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951331.633872:0:22774:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783951331.633875:0:22774:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e037ca6d800 from 13 10000000:01000000:3.0:1783951331.633878:0:22774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951331.633915:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03427e8200/0x7645c8e1169f9bb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951331.633924:0:22774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e03427e8200/0x7645c8e1169f9bb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951331.633942:0:22774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e03427e8200/0x7645c8e1169f9bb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951331.633966:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945017728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951331.634028:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951331.634084:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951331.634176:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945017728 00000100:00100000:2.0:1783951331.634184:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945017728 00000100:00100000:2.0:1783951331.634329:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783951331.634340:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+17:22774:x1870607945017728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951331.634489:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951331.634507:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f9bbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9bb4 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951331.634534:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f9bbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9bb4 expref: 18 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951331.634624:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f9bbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9bb4 expref: 18 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951331.634633:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247948c00, rc 0) 00000100:00100000:2.0:1783951331.634721:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+18:22774:x1870607945017728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 383us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951331.634729:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783951331.634884:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945017728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951331.634899:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e03427e8200/0x7645c8e1169f9bb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9bbb expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951331.634907:0:22774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e03427e8200/0x7645c8e1169f9bb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9bbb expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951331.634966:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945017856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951331.634992:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951331.635024:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951331.635074:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945017856 00000100:00100000:2.0:1783951331.635078:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945017856 00000100:00100000:2.0:1783951331.635106:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783951331.635113:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+18:22774:x1870607945017856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951331.635252:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+18:22774:x1870607945017856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951331.635259:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783951331.635512:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945017856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951331.635540:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945017984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951331.635576:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951331.635605:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03465da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951331.635659:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945017984 00000100:00100000:2.0:1783951331.635663:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945017984 00000100:00100000:2.0:1783951331.635693:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783951331.635700:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+18:22774:x1870607945017984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951331.635815:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+18:22774:x1870607945017984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951331.635830:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783951331.635955:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945017984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783951331.637500:0:24000:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783951331.637773:0:22774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783951331.637795:0:22774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783951331.637807:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03427e8200/0x7645c8e1169f9bb4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9bbb expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951331.637819:0:22774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e03427e8200/0x7645c8e1169f9bb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9bbb expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951331.877251:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951331.937017:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951331.937042:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945018112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951331.937113:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951331.937182:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945018112 00000100:00100000:1.0:1783951331.937198:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945018112 00000100:00100000:1.0:1783951331.937245:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783951331.937255:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1870607945018112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783951331.937293:0:22783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783951331.937348:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1870607945018112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951331.937357:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783951331.937417:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945018112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951331.937498:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945018240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951331.937525:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951331.937554:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945018240 00000100:00100000:1.0:1783951331.937558:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945018240 00000100:00100000:1.0:1783951331.937581:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783951331.937588:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945018240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783951331.937692:0:22783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783951331.937733:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945018240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 144us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951331.937741:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783951331.937930:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951321/real 1783951321] req@ffff9e037e425180 x1870607945012096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951331 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951331.937966:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e037e425180 x1870607945012096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951331 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951331.937976:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951321/real 1783951321] req@ffff9e037e424380 x1870607945011840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951331 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951331.937988:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e037e424380 x1870607945011840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951331 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951331.938001:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246426800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1783951331.938090:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945018240:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1783951331.942885:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951331.942897:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951331.942900:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951331.942903:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951331.942960:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951331.942977:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951331.942980:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951331.942982:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783951331.942986:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e0246426800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951331.942995:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 677 00000100:00080000:1.0:1783951331.943001:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783951331.943008:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e0246426800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951331.943040:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e02483a2680 x1870607945018496/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951331.943084:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951331.943103:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607945018368:0@lo:400:kworker.0 00000100:00100000:1.0:1783951331.943192:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951331.943237:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607945018624:0@lo:400:kworker.0 00000100:00100000:1.0:1783951331.943261:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951331.943291:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945018368 00000100:00100000:1.0:1783951331.943298:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945018368 00000100:00100000:1.0:1783951331.943338:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945018624 00000100:00100000:1.0:1783951331.943341:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945018624 00000100:00100000:1.0:1783951331.943369:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783951331.943378:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607945018368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951331.943432:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607945018368:12345-0@lo:400:kworker.0 Request processed in 53us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951331.943439:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783951331.943455:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783951331.943461:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607945018624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951331.943969:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607945018624:12345-0@lo:400:kworker.0 Request processed in 507us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951331.943976:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1783951331.944014:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e02483a3b80 x1870607945018624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951331.944027:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607945018624:0@lo:400:kworker.0 00010000:00080000:1.0:1783951331.944057:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e037d244e00 x1870607945018368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951331.944067:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607945018368:0@lo:400:kworker.0 00000100:00080000:2.0:1783951331.944759:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783951331.944777:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945012096:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783951331.944786:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246426000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951331.947289:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951331.947299:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783951331.947303:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951331.947305:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783951331.947309:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951331.947314:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783951331.947318:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e0246426000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951331.947327:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 677 00000100:00080000:0.0:1783951331.947333:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783951331.947341:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e0246426000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783951331.947391:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037e424700 x1870607945018752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951331.949589:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783951331.949601:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945011840:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783951331.949728:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945018496:0@lo:8:kworker.0 00000400:00000100:2.0:1783951331.949859:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607945018496 offset 0 length 520: 4 00000100:00100000:2.0:1783951331.949900:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945018752:0@lo:8:kworker.0 00000400:00000100:2.0:1783951331.949924:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607945018752 offset 0 length 520: 4 00000100:00080000:1.0:1783951331.950005:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951331.950010:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951331.950013:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951331.950016:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000001:00100000:2.0:1783951332.450107:0:23509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1783951332.899250:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783951333.027321:0:23527:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783951333.920239:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951333.984506:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951318/real 1783951318] req@ffff9e037d247b80 x1870607945009920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951333 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951333.984539:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e037d247b80 x1870607945009920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951333 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951333.984549:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951318/real 1783951318] req@ffff9e037d246300 x1870607945010048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951333 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951333.984559:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e037d246300 x1870607945010048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951333 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783951333.984579:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e037e6db800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951333.984603:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783951333.984607:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945009920:0@lo:8:kworker.0 00000100:00080000:0.0:1783951333.984612:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e035079f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951333.984616:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783951333.984619:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945010048:0@lo:8:kworker.0 00000100:00080000:3.0:1783951333.984857:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951333.984862:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783951333.984865:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e037e6db800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951333.984891:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 673 00000100:00080000:3.0:1783951333.984897:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783951333.984902:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e037e6db800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951333.984924:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037fc64700 x1870607945019136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951333.984935:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951333.984937:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783951333.984939:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e035079f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951333.984942:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 673 00000100:00080000:3.0:1783951333.984944:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783951333.984947:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e035079f800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951333.984958:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037fc66300 x1870607945019264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951333.984976:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951333.984979:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783951333.984981:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783951333.984984:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783951333.985234:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945019008:0@lo:400:kworker.0 00000100:00100000:2.0:1783951333.985296:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951333.985337:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951333.985354:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607945019392:0@lo:400:kworker.0 00000100:00100000:2.0:1783951333.985384:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951333.985580:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945019520:0@lo:400:kworker.0 00000100:00100000:1.0:1783951333.985612:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951333.985643:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783951333.985649:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b1b2cfa-7097-4258-904b-0084ac551497:3652:1870607945018880:0@lo:400:kworker.0 00000100:00100000:1.0:1783951333.985673:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951333.985697:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607945019648:0@lo:400:kworker.0 00000100:00100000:1.0:1783951333.985717:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951333.985747:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945019008 00000100:00100000:1.0:1783951333.985755:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945019008 00000100:00100000:1.0:1783951333.985788:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945019520 00000100:00100000:1.0:1783951333.985799:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945019520 00000100:00100000:1.0:1783951333.985820:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783951333.985829:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945019008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951333.985896:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945019008:12345-0@lo:400:kworker.0 Request processed in 54us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951333.985903:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783951333.985919:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783951333.985925:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945019520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951333.985957:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945019520:12345-0@lo:400:kworker.0 Request processed in 32us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951333.985963:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783951333.985981:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945018880 00000100:00100000:1.0:1783951333.985984:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945018880 00000100:00100000:1.0:1783951333.986008:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783951333.986013:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+18:3652:x1870607945018880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951333.986041:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+18:3652:x1870607945018880:12345-0@lo:400:kworker.0 Request processed in 27us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951333.986047:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783951333.986072:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945019392 00000100:00100000:1.0:1783951333.986076:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945019392 00000100:00100000:1.0:1783951333.986098:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945019648 00000100:00100000:1.0:1783951333.986101:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945019648 00000100:00100000:1.0:1783951333.986113:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783951333.986119:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607945019392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951333.986174:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607945019392:12345-0@lo:400:kworker.0 Request processed in 55us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951333.986180:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783951333.986353:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783951333.986360:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607945019648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951333.986390:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607945019648:12345-0@lo:400:kworker.0 Request processed in 30us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951333.986395:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783951333.986433:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0342e82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b1b2cfa-7097-4258-904b-0084ac551497:3652:1870607945018880:0@lo:400:kworker.0 00010000:00080000:1.0:1783951333.986446:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e037fc64000 x1870607945019648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951333.986456:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607945019648:0@lo:400:kworker.0 00000100:00100000:1.0:1783951333.986466:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945019520:0@lo:400:kworker.0 00010000:00080000:1.0:1783951333.986502:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e037fc66d80 x1870607945019392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951333.986510:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607945019392:0@lo:400:kworker.0 00000100:00100000:1.0:1783951333.986519:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945019008:0@lo:400:kworker.0 00000100:00100000:0.0:1783951333.987854:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945019136:0@lo:8:kworker.0 00000400:00000100:0.0:1783951333.987920:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607945019136 offset 0 length 520: 4 00000100:00100000:0.0:1783951333.987959:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945019264:0@lo:8:kworker.0 00000400:00000100:0.0:1783951333.987982:0:3651:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870607945019264 offset 0 length 520: 4 00010000:00010000:1.0:1783951334.944741:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951335.968279:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783951336.563548:0:24276:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783951336.563552:0:24276:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1783951336.563553:0:24276:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1783951336.563668:0:24276:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e036b543000 00000020:01000004:3.0:1783951336.563685:0:24276:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783951336.563700:0:24276:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783951336.563713:0:24276:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e0247753380) 00000020:00000080:3.0:1783951336.563730:0:24276:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783951336.603579:0:24276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783951336.604760:0:24276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783951336.605163:0:24276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783951336.605494:0:24276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1783951336.605719:0:24276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783951336.605908:0:24276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1783951336.606135:0:24276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:3.0:1783951336.609891:0:24276:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783951336.610112:0:24276:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1783951336.610126:0:24276:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783951336.610361:0:24276:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7645c8e1169f9bc9 00000020:01000004:3.0:1783951336.610379:0:24276:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1783951336.610403:0:24276:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.133@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783951336.610407:0:24276:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783951336.610414:0:24276:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1783951336.610420:0:24276:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1783951336.610432:0:24276:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e0247754d40) 00000020:00000080:3.0:1783951336.610444:0:24276:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1783951336.611529:0:24276:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783951336.611678:0:24276:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1783951336.611684:0:24276:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1783951336.617692:0:24276:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1783951336.617706:0:24276:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1783951336.618050:0:24276:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1783951336.618056:0:24276:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1783951336.619356:0:24276:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951336.619614:0:24276:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1783951336.619618:0:24276:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1783951336.622609:0:24276:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1783951336.622620:0:24276:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1783951336.641689:0:24276:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783951336.641870:0:24276:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783951336.641874:0:24276:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1783951336.643701:0:24276:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783951336.643718:0:24276:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1783951336.646001:0:24276:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783951336.646018:0:24276:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1783951336.648024:0:24276:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783951336.648731:0:24276:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1783951336.648737:0:24276:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1783951336.649451:0:24276:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1783951336.649458:0:24276:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783951336.695119:0:24276:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783951336.695906:0:24276:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783951336.695914:0:24276:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1783951336.703124:0:24276:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1783951336.703177:0:24276:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1783951336.710186:0:24276:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1783951336.710218:0:24276:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1783951336.710225:0:24276:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.133@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1783951336.743027:0:24276:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783951336.743080:0:24276:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.133@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1783951336.743085:0:24276:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783951336.743087:0:24276:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783951336.743088:0:24276:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951336.743089:0:24276:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951336.743090:0:24276:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951336.743092:0:24276:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951336.743093:0:24276:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783951336.743096:0:24276:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951336.743097:0:24276:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783951336.743101:0:24276:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1783951336.743109:0:24276:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783951336.743110:0:24276:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783951336.743111:0:24276:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951336.743112:0:24276:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951336.743113:0:24276:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951336.743114:0:24276:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951336.743114:0:24276:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783951336.743115:0:24276:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951336.743116:0:24276:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783951336.743971:0:24276:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783951336.743998:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945019776:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783951336.744088:0:24276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951336.744351:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e034328b480 going to sleep for 11 seconds 00000100:00100000:3.0:1783951336.746555:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945019776 00000100:00100000:3.0:1783951336.746569:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945019776 00000100:00100000:3.0:1783951336.746676:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783951336.746687:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+18:24276:x1870607945019776:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783951336.746746:0:22769:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783951336.746750:0:22769:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1783951336.746754:0:22769:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1783951336.747280:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+18:24276:x1870607945019776:12345-0@lo:253:mount.lustre.0 Request processed in 594us (3190us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951336.747308:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783951336.747437:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945019776:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783951336.747454:0:24276:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783951336.747458:0:24276:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783951336.747460:0:24276:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783951336.747461:0:24276:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951336.747462:0:24276:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951336.747464:0:24276:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951336.747465:0:24276:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951336.747467:0:24276:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783951336.747469:0:24276:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951336.747470:0:24276:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783951336.747506:0:24276:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e036b543000 from lustre-OST0000 10000000:01000000:2.0:1783951336.747556:0:24276:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783951336.747559:0:24276:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783951336.747573:0:24276:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e037795b380 local copy 00010000:00010000:2.0:1783951336.747583:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f9984 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f998b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951336.747704:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945019904:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951336.747743:0:24276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951336.748712:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783951336.748772:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945019904 00000100:00100000:1.0:1783951336.748779:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945019904 00000100:00100000:1.0:1783951336.748819:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783951336.748827:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ca4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+18:24276:x1870607945019904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951336.748972:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ca4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+18:24276:x1870607945019904:12345-0@lo:501:mount.lustre.0 Request processed in 145us (1228us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783951336.748980:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783951336.749129:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945019904:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783951336.749944:0:24276:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783951336.749979:0:24276:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783951336.749989:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f9984 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f998b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.749999:0:24276:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f9984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f998b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951336.750041:0:24276:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e036b543000 10000000:01000000:2.0:1783951336.750047:0:24276:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783951336.750052:0:24276:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783951336.750055:0:24276:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783951336.750059:0:24276:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1783951336.750062:0:24276:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783951336.750090:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948a00/0x7645c8e1169f9bd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.750098:0:24276:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247948a00/0x7645c8e1169f9bd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.750107:0:24276:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247948a00/0x7645c8e1169f9bd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951336.750259:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945020032:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951336.750546:0:24276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951336.750583:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783951336.750682:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945020032 00000100:00100000:1.0:1783951336.750689:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945020032 00000100:00100000:1.0:1783951336.750725:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783951336.750732:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ca49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+18:24276:x1870607945020032:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951336.750743:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951336.750756:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03413c3600/0x7645c8e1169f9bde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9bd7 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951336.750779:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03413c3600/0x7645c8e1169f9bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9bd7 expref: 19 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951336.750804:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03413c3600/0x7645c8e1169f9bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9bd7 expref: 19 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951336.750812:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03413c3600, rc 0) 00000100:00100000:1.0:1783951336.750847:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ca49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+19:24276:x1870607945020032:12345-0@lo:101:mount.lustre.0 Request processed in 115us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951336.750852:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783951336.750982:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945020032:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951336.750995:0:24276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247948a00/0x7645c8e1169f9bd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9bde expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.751004:0:24276:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247948a00/0x7645c8e1169f9bd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9bde expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783951336.752703:0:24276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1783951336.753842:0:24276:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783951336.760132:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1783951336.760972:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1783951336.760993:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1783951336.761012:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1783951336.761029:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1783951336.761044:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1783951336.761081:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1783951336.761100:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1783951336.761116:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1783951336.761132:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1783951336.763375:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1783951336.763418:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1783951336.763450:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1783951336.763456:0:24276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1783951336.763690:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945020160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951336.763757:0:24276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951336.763807:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1783951336.763966:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945020160 00000100:00100000:1.0:1783951336.763974:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945020160 00000100:00100000:1.0:1783951336.764032:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783951336.764041:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ca48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+19:24276:x1870607945020160:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951336.764231:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ca48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+19:24276:x1870607945020160:12345-0@lo:501:mount.lustre.0 Request processed in 190us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951336.764240:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783951336.764584:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945020160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951336.764639:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945020288:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951336.764687:0:24276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951336.764718:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0248072900 going to sleep for 11 seconds 00000100:00100000:2.0:1783951336.764784:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945020288 00000100:00100000:2.0:1783951336.764789:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945020288 00000100:00100000:2.0:1783951336.764823:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783951336.764830:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ca49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+19:24276:x1870607945020288:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951336.767039:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ca49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+19:24276:x1870607945020288:12345-0@lo:503:mount.lustre.0 Request processed in 2201us (2343us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951336.767053:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783951336.767209:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945020288:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783951336.768002:0:24276:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783951336.768098:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945020416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951336.768193:0:24276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951336.768235:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0248072900 going to sleep for 11 seconds 00000100:00100000:2.0:1783951336.769650:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945020416 00000100:00100000:2.0:1783951336.769661:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945020416 00000100:00100000:2.0:1783951336.769711:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783951336.769720:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+19:24276:x1870607945020416:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951336.770845:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+19:24276:x1870607945020416:12345-0@lo:502:mount.lustre.0 Request processed in 1121us (2648us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951336.770856:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783951336.770953:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945020416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783951336.771239:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1783951336.771273:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1783951336.771290:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1783951336.771330:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1783951336.771349:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1783951336.772344:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1783951336.772462:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1783951336.772546:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1783951336.772568:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1783951336.772581:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1783951336.772594:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1783951336.772609:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1783951336.772670:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945020544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951336.772737:0:24276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951336.772825:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0248072900 going to sleep for 11 seconds 00000100:00100000:2.0:1783951336.774037:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945020544 00000100:00100000:2.0:1783951336.774049:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945020544 00000100:00100000:2.0:1783951336.774103:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783951336.774112:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+19:24276:x1870607945020544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951336.774288:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+19:24276:x1870607945020544:12345-0@lo:502:mount.lustre.0 Request processed in 175us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951336.774306:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783951336.774731:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945020544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783951336.774812:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1783951336.774823:0:24276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1783951336.777446:0:24293:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783951336.777458:0:24293:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1783951336.777465:0:24293:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951336.777467:0:24293:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1783951336.777474:0:24293:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783951336.777610:0:24293:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e0246b40000) 00000020:00000080:0.0:1783951336.777651:0:24293:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783951336.777660:0:24293:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783951336.777761:0:24293:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e036b543000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1783951336.777771:0:24293:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783951336.777786:0:24293:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7645c8e1169f9bec 00010000:00010000:0.0:1783951336.789052:0:24293:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1783951336.790259:0:24293:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1783951336.792071:0:24293:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1783951336.797902:0:24293:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1783951336.797917:0:24293:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951336.797924:0:24293:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951336.797926:0:24293:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1783951336.797930:0:24293:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783951336.797933:0:24293:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1783951336.797940:0:24293:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783951336.797942:0:24293:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783951336.797943:0:24293:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783951336.797946:0:24293:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951336.797948:0:24293:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783951336.797950:0:24293:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951336.797954:0:24293:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951336.797956:0:24293:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783951336.797958:0:24293:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783951336.797960:0:24293:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783951336.797963:0:24293:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951336.797965:0:24293:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951336.797966:0:24293:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783951336.797969:0:24293:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951336.797971:0:24293:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951336.797972:0:24293:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783951336.797975:0:24293:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783951336.798013:0:24293:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951336.798017:0:24293:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951336.798018:0:24293:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783951336.798022:0:24293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1783951336.798272:0:24276:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1783951336.798303:0:24276:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783951336.798327:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247948a00/0x7645c8e1169f9bd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9bde expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951336.798351:0:24276:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247948a00/0x7645c8e1169f9bd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9bde expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951336.798360:0:24276:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e036b543000 from 1 10000000:01000000:0.0:1783951336.798363:0:24276:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783951336.798408:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f9bf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951336.798416:0:24276:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f9bf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951336.798425:0:24276:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f9bf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951336.798449:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945020672:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951336.798516:0:24276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951336.798558:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0248072f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783951336.798754:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945020672 00000100:00100000:2.0:1783951336.798762:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945020672 00000100:00100000:2.0:1783951336.798812:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783951336.798822:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+19:24276:x1870607945020672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951336.798836:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951336.798851:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9bfa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9bf3 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.798874:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9bfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9bf3 expref: 20 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.798884:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9bfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9bf3 expref: 20 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.798900:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247949a00, rc 0) 00000100:00100000:2.0:1783951336.798940:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+20:24276:x1870607945020672:12345-0@lo:101:mount.lustre.0 Request processed in 120us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951336.798947:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783951336.800678:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945020672:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951336.800705:0:24276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f9bf3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9bfa expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951336.800719:0:24276:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f9bf3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9bfa expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783951336.802866:0:24276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1783951336.803137:0:24276:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951336.803599:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1783951336.803701:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1783951336.803733:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1783951336.803769:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1783951336.803788:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1783951336.803805:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1783951336.803820:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1783951336.803835:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1783951336.803852:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1783951336.803868:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1783951336.803884:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1783951336.803905:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1783951336.803910:0:24276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1783951336.803987:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945020800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951336.804055:0:24276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951336.804208:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0369923cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951336.811883:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945020800 00000100:00100000:3.0:1783951336.811896:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945020800 00000100:00100000:3.0:1783951336.811956:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783951336.811966:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+20:24276:x1870607945020800:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951336.812192:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+20:24276:x1870607945020800:12345-0@lo:501:mount.lustre.0 Request processed in 227us (8136us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951336.812200:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783951336.812389:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945020800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951336.812440:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945020928:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951336.812492:0:24276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951336.812535:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0369923cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951336.812660:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945020928 00000100:00100000:3.0:1783951336.812664:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945020928 00000100:00100000:3.0:1783951336.812694:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783951336.812701:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+20:24276:x1870607945020928:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951336.812780:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+20:24276:x1870607945020928:12345-0@lo:503:mount.lustre.0 Request processed in 79us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951336.812787:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783951336.813265:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945020928:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783951336.814553:0:24276:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783951336.815313:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945021056:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951336.815495:0:24276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951336.815581:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036d3a0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951336.824516:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945021056 00000100:00100000:3.0:1783951336.824530:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945021056 00000100:00100000:3.0:1783951336.824601:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783951336.824612:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+20:24276:x1870607945021056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951336.824797:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+20:24276:x1870607945021056:12345-0@lo:502:mount.lustre.0 Request processed in 187us (9302us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951336.824806:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783951336.825004:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945021056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783951336.825577:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1783951336.825615:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1783951336.825636:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1783951336.825652:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1783951336.825666:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1783951336.825680:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1783951336.825694:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1783951336.825707:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1783951336.825721:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1783951336.825734:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1783951336.825749:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1783951336.825783:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945021184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951336.825833:0:24276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951336.825873:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951336.826525:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945021184 00000100:00100000:0.0:1783951336.826534:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945021184 00000100:00100000:0.0:1783951336.826576:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783951336.826583:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+20:24276:x1870607945021184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951336.826723:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+20:24276:x1870607945021184:12345-0@lo:502:mount.lustre.0 Request processed in 139us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951336.826731:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783951336.826855:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945021184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783951336.826912:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1783951336.826921:0:24276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1783951336.847605:0:24297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951336.847622:0:24297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951336.847635:0:24297:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783951336.847645:0:24297:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e036b543000 00000020:00000080:3.0:1783951336.847653:0:24297:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783951336.847663:0:24297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951336.847665:0:24297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951336.847667:0:24297:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783951336.847669:0:24297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951336.847672:0:24297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951336.847673:0:24297:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783951336.847677:0:24297:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e036b543000 00000020:00000080:3.0:1783951336.847679:0:24297:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783951336.847781:0:24297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951336.847785:0:24297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951336.847786:0:24297:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783951336.847789:0:24297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951336.847792:0:24297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951336.847793:0:24297:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783951336.847796:0:24297:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e036b543000 00000020:00000080:3.0:1783951336.847798:0:24297:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783951336.852540:0:24297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951336.852556:0:24297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951336.852558:0:24297:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783951336.852563:0:24297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951336.852567:0:24297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951336.852569:0:24297:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783951336.852574:0:24297:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e036b543000 00000020:00000080:3.0:1783951336.852577:0:24297:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783951336.853789:0:24297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951336.853800:0:24297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951336.853802:0:24297:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783951336.853807:0:24297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1783951336.867342:0:24276:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783951336.867397:0:24276:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783951336.867426:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f9bf3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9bfa expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951336.867438:0:24276:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f9bf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9bfa expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951336.867497:0:24276:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783951336.867500:0:24276:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e036b543000 10000000:01000000:0.0:1783951336.867503:0:24276:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e036b543000 10000000:01000000:0.0:1783951336.867507:0:24276:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783951336.867513:0:24276:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e036b543000 from 1 10000000:01000000:0.0:1783951336.867515:0:24276:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783951336.867553:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f9c01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951336.867562:0:24276:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f9c01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951336.867572:0:24276:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f9c01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951336.867597:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945021312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951336.867678:0:24276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951336.867721:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036d3a0600 going to sleep for 11 seconds 00000100:00100000:1.0:1783951336.868470:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945021312 00000100:00100000:1.0:1783951336.868479:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945021312 00000100:00100000:1.0:1783951336.868524:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783951336.868535:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+20:24276:x1870607945021312:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951336.868552:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951336.868567:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03413c2600/0x7645c8e1169f9c08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9c01 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951336.868596:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03413c2600/0x7645c8e1169f9c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9c01 expref: 21 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951336.868608:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03413c2600/0x7645c8e1169f9c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9c01 expref: 21 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951336.870581:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03413c2600, rc 0) 00000100:00100000:1.0:1783951336.871952:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+21:24276:x1870607945021312:12345-0@lo:101:mount.lustre.0 Request processed in 3412us (4267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951336.871966:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783951336.887587:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945021312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951336.887619:0:24276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f9c01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9c08 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951336.887649:0:24276:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f9c01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9c08 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783951336.894957:0:24276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1783951336.897002:0:24276:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783951336.897640:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1783951336.897680:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1783951336.897701:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1783951336.897732:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1783951336.897750:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1783951336.897765:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1783951336.897783:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1783951336.897800:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1783951336.897819:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1783951336.897836:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1783951336.897851:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1783951336.897866:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1783951336.899599:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1783951336.899777:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1783951336.899796:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1783951336.899811:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1783951336.899826:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1783951336.899842:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1783951336.899857:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1783951336.899872:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1783951336.899903:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1783951336.899936:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1783951336.899954:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1783951336.899969:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1783951336.899982:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1783951336.899995:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1783951336.900012:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1783951336.900029:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1783951336.900045:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1783951336.900060:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1783951336.900076:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1783951336.900091:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1783951336.900106:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1783951336.900123:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1783951336.900459:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1783951336.900487:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1783951336.900516:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1783951336.900549:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1783951336.900569:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1783951336.900586:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1783951336.900604:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1783951336.900621:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1783951336.900663:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1783951336.900682:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1783951336.900700:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1783951336.900717:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1783951336.900735:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1783951336.900752:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1783951336.900957:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1783951336.900981:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1783951336.901003:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1783951336.901010:0:24276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1783951336.901118:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945021440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951336.901218:0:24276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951336.901257:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037799e240 going to sleep for 11 seconds 00000100:00100000:3.0:1783951336.906066:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945021440 00000100:00100000:3.0:1783951336.906081:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945021440 00000100:00100000:3.0:1783951336.906175:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783951336.906187:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+21:24276:x1870607945021440:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951336.906407:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+21:24276:x1870607945021440:12345-0@lo:501:mount.lustre.0 Request processed in 223us (5188us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951336.906415:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783951336.908492:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945021440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951336.908553:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945021568:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951336.908618:0:24276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951336.908661:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037799e240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951336.908758:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945021568 00000100:00100000:1.0:1783951336.908765:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945021568 00000100:00100000:1.0:1783951336.910581:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783951336.910600:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+21:24276:x1870607945021568:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951336.910770:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+21:24276:x1870607945021568:12345-0@lo:503:mount.lustre.0 Request processed in 176us (2151us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951336.910778:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783951336.912509:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945021568:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783951336.912956:0:24276:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783951336.913060:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945021696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951336.913131:0:24276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951336.916806:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945021696 00000100:00100000:3.0:1783951336.916821:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945021696 00000100:00100000:3.0:1783951336.916873:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783951336.916884:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+21:24276:x1870607945021696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951336.917037:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+21:24276:x1870607945021696:12345-0@lo:502:mount.lustre.0 Request processed in 154us (3904us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951336.917045:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783951336.918786:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037799e240 going to sleep for 11 seconds 00000100:00100000:3.0:1783951336.918818:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945021696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783951336.919093:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1783951336.919130:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1783951336.920867:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1783951336.920904:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1783951336.920922:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1783951336.920937:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1783951336.920953:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1783951336.920968:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1783951336.921008:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1783951336.921028:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1783951336.921045:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1783951336.921060:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1783951336.921077:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1783951336.921093:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1783951336.921109:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1783951336.921125:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1783951336.926952:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1783951336.927000:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1783951336.927017:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1783951336.927032:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1783951336.927047:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1783951336.927062:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1783951336.927079:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1783951336.927097:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1783951336.927113:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1783951336.927129:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1783951336.927186:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1783951336.927208:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1783951336.927229:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1783951336.927247:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1783951336.927473:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1783951336.927498:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1783951336.927518:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1783951336.927535:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1783951336.927553:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1783951336.927569:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1783951336.927584:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1783951336.927598:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1783951336.927613:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1783951336.927691:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1783951336.927711:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1783951336.927726:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1783951336.927742:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1783951336.927757:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1783951336.927778:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1783951336.927792:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1783951336.927821:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1783951336.927838:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1783951336.927900:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945021824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951336.927982:0:24276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951336.928024:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037799e180 going to sleep for 11 seconds 00000100:00100000:3.0:1783951336.928193:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945021824 00000100:00100000:3.0:1783951336.928201:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945021824 00000100:00100000:3.0:1783951336.928256:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783951336.928266:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+21:24276:x1870607945021824:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951336.928572:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+21:24276:x1870607945021824:12345-0@lo:502:mount.lustre.0 Request processed in 306us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951336.928580:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783951336.928764:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945021824:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783951336.928966:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1783951336.928995:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1783951336.929025:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945021952:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951336.929065:0:24276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951336.929108:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036d3a0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951336.929196:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945021952 00000100:00100000:2.0:1783951336.929202:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945021952 00000100:00100000:2.0:1783951336.929235:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783951336.929243:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+21:24276:x1870607945021952:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951336.929512:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+21:24276:x1870607945021952:12345-0@lo:502:mount.lustre.0 Request processed in 269us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951336.929519:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783951336.929608:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945021952:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783951336.929736:0:24276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1783951336.929745:0:24276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1783951336.930857:0:24303:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783951336.930876:0:24303:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e037d0ab380) 00000020:00000080:3.0:1783951336.930900:0:24303:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1783951336.931132:0:24303:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e036b543000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783951336.931137:0:24303:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e036b543000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783951336.931177:0:24303:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e036b543000 3 00010000:00080000:3.0:1783951336.931206:0:24303:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0247765000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.133@tcp at head 00010000:00010000:3.0:1783951336.936614:0:24303:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1783951336.936766:0:24303:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783951336.936809:0:24303:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783951336.936834:0:24303:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7645c8e1169f9c16 00000100:00080000:3.0:1783951336.936843:0:24303:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783951336.936849:0:24303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e0247765000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1783951336.936882:0:24303:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037fc67b80 x1870607945022080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951336.936907:0:24303:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783951336.937045:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1870607945022080:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783951336.937109:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951336.937493:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945022080 00000100:00100000:3.0:1783951336.937500:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945022080 00000100:00100000:3.0:1783951336.937541:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783951336.937548:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1870607945022080:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783951336.937570:0:22777:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:3.0:1783951336.937621:0:22777:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7645c8e1169f9c1d 00000004:00100000:3.0:1783951336.937744:0:22777:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783951336.937774:0:22777:0:(import.c:65:import_set_state_nolock()) ffff9e02474d9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951336.937889:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1870607945022080:12345-0@lo:38:llog_process_th.0 Request processed in 339us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951336.937897:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1783951336.938593:0:24303:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783951336.938609:0:24303:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9e036b308000) 00000020:00000080:2.0:1783951336.938640:0:24303:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1783951336.938803:0:24303:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e036b543000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783951336.938808:0:24303:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e036b543000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783951336.938811:0:24303:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e036b543000 3 00010000:00080000:2.0:1783951336.938835:0:24303:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0247766000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.133@tcp at head 00000100:00080000:1.0:1783951336.940350:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951336.940357:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951336.940360:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951336.940491:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951336.940526:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951336.940530:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951336.940539:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951336.940542:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783951336.940998:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945022208:0@lo:400:kworker.0 00000100:00100000:1.0:1783951336.941067:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951336.941104:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951336.941110:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607945022336:0@lo:400:kworker.0 00000100:00100000:1.0:1783951336.941134:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951336.941427:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945022464:0@lo:400:kworker.0 00000100:00100000:1.0:1783951336.941457:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951336.941487:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951336.941493:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607945022592:0@lo:400:kworker.0 00000100:00100000:1.0:1783951336.941515:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951336.941556:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945022208 00000100:00100000:1.0:1783951336.941563:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945022208 00000100:00100000:1.0:1783951336.941593:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945022464 00000100:00100000:1.0:1783951336.941597:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945022464 00000100:00100000:1.0:1783951336.941611:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783951336.941620:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945022208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951336.942457:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945022208:12345-0@lo:400:kworker.0 Request processed in 835us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951336.942467:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783951336.942490:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783951336.942501:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945022464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951336.942533:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945022464:12345-0@lo:400:kworker.0 Request processed in 34us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951336.942550:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783951336.942575:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945022336 00000100:00100000:1.0:1783951336.942580:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945022336 00000100:00100000:1.0:1783951336.942609:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945022592 00000100:00100000:1.0:1783951336.942613:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945022592 00000100:00100000:1.0:1783951336.942742:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783951336.942749:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607945022336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951336.942781:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607945022336:12345-0@lo:400:kworker.0 Request processed in 34us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951336.942787:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783951336.942799:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783951336.942804:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607945022592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951336.942827:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607945022592:12345-0@lo:400:kworker.0 Request processed in 23us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951336.942832:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1783951336.942866:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e02483a0380 x1870607945022336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951336.942881:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607945022336:0@lo:400:kworker.0 00000100:00100000:1.0:1783951336.942893:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945022208:0@lo:400:kworker.0 00010000:00080000:1.0:1783951336.942925:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e02483a1500 x1870607945022592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951336.942934:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607945022592:0@lo:400:kworker.0 00000100:00100000:1.0:1783951336.942943:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945022464:0@lo:400:kworker.0 00010000:00010000:2.0:1783951336.943964:0:24303:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1783951336.944062:0:24303:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1783951336.944104:0:24303:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783951336.944116:0:24303:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x7645c8e1169f9c2b 00000100:00080000:2.0:1783951336.944126:0:24303:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951336.944131:0:24303:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9e0247766000 using connection 192.168.202.133@tcp/0@lo 00010000:00080000:0.0:1783951336.944973:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e037fc67b80 x1870607945022080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951336.944985:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783951336.944996:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1783951336.945004:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783951336.945008:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783951336.945012:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0247765000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783951336.945019:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3651:1870607945022080:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783951336.946360:0:24303:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0248608700 x1870607945022720/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951336.946457:0:24303:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783951336.946494:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783951336.946498:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783951336.946508:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783951336.946511:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783951336.946515:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783951336.946517:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783951336.946520:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783951336.946523:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783951336.947743:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3651:1870607945022720:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783951336.947820:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1783951336.948033:0:24303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1783951336.948716:0:24276:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783951336.948750:0:24276:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783951336.948767:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f9c01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9c08 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951336.948788:0:24276:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3800/0x7645c8e1169f9c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9c08 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783951336.948839:0:24276:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783951336.948841:0:24276:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783951336.948843:0:24276:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951336.948844:0:24276:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951336.948845:0:24276:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951336.948847:0:24276:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951336.948848:0:24276:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783951336.948850:0:24276:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951336.948851:0:24276:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783951336.948854:0:24276:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1783951336.948856:0:24276:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783951336.948858:0:24276:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783951336.948859:0:24276:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951336.948860:0:24276:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951336.948861:0:24276:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951336.948862:0:24276:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951336.948863:0:24276:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783951336.948864:0:24276:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951336.948865:0:24276:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783951336.948886:0:24276:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783951336.948899:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945022848:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783951336.948938:0:24276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951336.948958:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036d3a0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783951336.949126:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945022720 00000100:00100000:2.0:1783951336.949441:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945022848 00000100:00100000:2.0:1783951336.949446:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945022848 00000100:00100000:2.0:1783951336.949490:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783951336.949499:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+21:24276:x1870607945022848:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783951336.949523:0:22772:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783951336.949536:0:22772:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1783951336.949697:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945022720 00000100:00100000:1.0:1783951336.949723:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783951336.949729:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1870607945022720:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783951336.949752:0:22778:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:1.0:1783951336.949785:0:22778:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x7645c8e1169f9c32 00000004:00100000:1.0:1783951336.949801:0:22778:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783951336.949831:0:22778:0:(import.c:65:import_set_state_nolock()) ffff9e036b6fc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951336.949885:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1870607945022720:12345-0@lo:38:llog_process_th.0 Request processed in 155us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951336.949892:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783951336.949950:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0248608700 x1870607945022720/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951336.949961:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783951336.949969:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1783951336.949976:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783951336.949980:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783951336.949983:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0247766000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783951336.949988:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3651:1870607945022720:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1783951336.962879:0:22772:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783951336.962896:0:22772:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783951336.965217:0:22793:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783951336.965227:0:22793:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783951336.965250:0:22793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f9c39 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951336.965269:0:22793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247949400/0x7645c8e1169f9b83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9b7c expref: 21 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951336.965303:0:22793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9b8a expref: 21 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951336.965311:0:22793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f9c39 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951336.965542:0:22793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f9b8a expref: 21 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951336.965559:0:22793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f9b8a expref: 21 pid: 22771 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951336.965576:0:22793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22793:1870607945022976:0@lo:104: 00000100:00100000:0.0:1783951336.965652:0:22793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783951336.965717:0:22793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247949400/0x7645c8e1169f9b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f9b7c expref: 21 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951336.965726:0:22793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247949400/0x7645c8e1169f9b83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f9b7c expref: 21 pid: 22769 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951336.965735:0:22793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22793:1870607945023104:0@lo:104: 00000100:00100000:0.0:1783951336.965759:0:22793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951336.965783:0:22793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036d3a0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783951336.966052:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+21:24276:x1870607945022848:12345-0@lo:253:mount.lustre.0 Request processed in 16553us (17112us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951336.966063:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783951336.966126:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:24276:1870607945022848:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783951336.966293:0:22761:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783951336.966311:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945022976 00000100:00100000:2.0:1783951336.966327:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945022976 00000100:00100000:2.0:1783951336.966356:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945023104 00000100:00100000:2.0:1783951336.966359:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945023104 00000100:00100000:2.0:1783951336.966506:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783951336.966515:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e424000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b1b2cfa-7097-4258-904b-0084ac551497+4:22793:x1870607945022976:12345-0@lo:104: 00010000:00010000:2.0:1783951336.966528:0:22761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9b91 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.966581:0:22761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783951336.966587:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e424000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b1b2cfa-7097-4258-904b-0084ac551497+4:22793:x1870607945022976:12345-0@lo:104: Request processed in 74us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951336.966608:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783951336.966622:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783951336.966629:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0380cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b1b2cfa-7097-4258-904b-0084ac551497+3:22793:x1870607945023104:12345-0@lo:104: 00010000:00010000:2.0:1783951336.966638:0:22761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9b7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9b83 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.966672:0:22761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783951336.966677:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0380cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b1b2cfa-7097-4258-904b-0084ac551497+3:22793:x1870607945023104:12345-0@lo:104: Request processed in 49us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951336.966682:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783951336.966739:0:22793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22793:1870607945022976:0@lo:104: 00000100:00100000:2.0:1783951336.966748:0:22793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22793:1870607945023104:0@lo:104: 00010000:00010000:2.0:1783951336.966768:0:22793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f9c39 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.966785:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783951336.966790:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9b91 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.966798:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783951336.966802:0:22765:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f9b91 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.966810:0:22765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f9b91 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951336.966818:0:22765:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f9b91 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951336.966830:0:22765:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951336.966860:0:22765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9b91 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.966866:0:22765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951336.966885:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9b91 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.966893:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247949e00/0x7645c8e1169f9b8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9b91 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.966904:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951336.966907:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9b7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9b83 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.966913:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c3e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1783951336.966916:0:22765:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9b7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f9b83 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.966922:0:22765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9b7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f9b83 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951336.966928:0:22765:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9b7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f9b83 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951336.966933:0:22765:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951336.966944:0:22765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9b7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9b83 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.966949:0:22765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951336.966961:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9b7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9b83 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.966968:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9b7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9b83 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.966980:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951336.966982:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951336.966984:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951336.966989:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951336.967006:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b1b2cfa-7097-4258-904b-0084ac551497:3654:1870607945023232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783951336.967037:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951336.967065:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951336.967070:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b1b2cfa-7097-4258-904b-0084ac551497:3654:1870607945023360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783951336.967092:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951336.967122:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945023232 00000100:00100000:2.0:1783951336.967125:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945023232 10000000:01000000:0.0:1783951336.967262:0:24276:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783951336.967274:0:24276:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783951336.967426:0:24276:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783951336.967428:0:24276:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951336.967430:0:24276:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951336.967431:0:24276:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951336.967432:0:24276:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951336.967434:0:24276:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783951336.967436:0:24276:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951336.967438:0:24276:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783951336.967452:0:24276:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1783951336.968644:0:22762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9b8a expref: 21 pid: 22771 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951336.968728:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945023360 00000100:00100000:2.0:1783951336.968734:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945023360 00010000:00010000:2.0:1783951336.968755:0:22762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247949400/0x7645c8e1169f9b83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9b7c expref: 22 pid: 22769 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951336.975118:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783951336.975137:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b1b2cfa-7097-4258-904b-0084ac551497+22:3654:x1870607945023232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951336.975180:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951336.975191:0:22763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9b8a expref: 22 pid: 22771 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951336.975208:0:22763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f9b8a expref: 22 pid: 22771 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951336.975227:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9b91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f9b8a expref: 22 pid: 22771 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951336.975243:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951336.975355:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b1b2cfa-7097-4258-904b-0084ac551497+21:3654:x1870607945023232:12345-0@lo:103:ldlm_bl.0 Request processed in 224us (8317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951336.975374:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783951336.975400:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783951336.975407:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036c661850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b1b2cfa-7097-4258-904b-0084ac551497+20:3654:x1870607945023360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951336.975414:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951336.975419:0:22763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247949400/0x7645c8e1169f9b83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9b7c expref: 20 pid: 22769 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951336.975439:0:22763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247949400/0x7645c8e1169f9b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f9b7c expref: 20 pid: 22769 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951336.975450:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247949400/0x7645c8e1169f9b83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f9b7c expref: 20 pid: 22769 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951336.975462:0:22763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f9c39 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951336.975470:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f9c39 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783951336.975485:0:22763:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010259313s 00010000:00010000:3.0:1783951336.975490:0:22763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f9c39 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951336.975497:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f9c39 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951336.975503:0:22763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f9c39 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951336.975510:0:22763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f9c39 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951336.975516:0:22763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b3e00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951336.975521:0:22763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f9c39 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951336.975530:0:22763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f9c39 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951336.975552:0:22763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f9c39 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951336.975563:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951336.975591:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036c661850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b1b2cfa-7097-4258-904b-0084ac551497+19:3654:x1870607945023360:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (8498us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951336.975598:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000001:00000004:1.0:1783951336.975777:0:24276:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1783951336.981476:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b1b2cfa-7097-4258-904b-0084ac551497:3654:1870607945023360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783951336.981493:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b1b2cfa-7097-4258-904b-0084ac551497:3654:1870607945023232:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783951336.981526:0:22793:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f9c39 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.981551:0:22793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f9c39 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951336.981560:0:22793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b3e00/0x7645c8e1169f9c39 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783951336.982027:0:24276:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1783951336.982033:0:24276:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1783951336.982072:0:24276:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783951336.982114:0:24276:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.133@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783951336.982133:0:24276:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1783951336.982792:0:24276:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1783951336.983914:0:24276:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783951336.984568:0:24276:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783951336.992531:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951337.058055:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783951337.058081:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607945023488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951337.058185:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951337.060769:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945023488 00000100:00100000:2.0:1783951337.060782:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945023488 00000100:00100000:2.0:1783951337.060835:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783951337.060845:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607945023488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783951337.060883:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783951337.060963:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607945023488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (2776us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951337.060970:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783951337.061034:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607945023488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951337.063767:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945023616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951337.063838:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951337.065552:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945023616 00000100:00100000:0.0:1783951337.065564:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945023616 00000100:00100000:0.0:1783951337.065618:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783951337.065629:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945023616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783951337.065668:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783951337.065748:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945023616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (1909us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951337.065756:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783951337.070253:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945023616:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783951338.016751:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783951338.043475:0:24357:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783951338.046947:0:24357:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1783951338.976603:0:22774:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783951338.976611:0:22774:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e0377b14000 from 13 10000000:01000000:2.0:1783951338.976615:0:22774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783951338.976659:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949800/0x7645c8e1169f9c40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951338.976672:0:22774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247949800/0x7645c8e1169f9c40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951338.976690:0:22774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247949800/0x7645c8e1169f9c40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951338.976715:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945023744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783951338.976780:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951338.976823:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036d3a0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951338.976870:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945023744 00000100:00100000:3.0:1783951338.976877:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945023744 00000100:00100000:3.0:1783951338.976927:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783951338.976938:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+19:22774:x1870607945023744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951338.976950:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951338.976964:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9c47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9c40 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951338.976987:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9c40 expref: 20 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951338.976999:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9c40 expref: 20 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951338.977019:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e8800, rc 0) 00000100:00100000:3.0:1783951338.977081:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+20:22774:x1870607945023744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951338.977088:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783951338.977241:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945023744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951338.977254:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247949800/0x7645c8e1169f9c40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9c47 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951338.977274:0:22774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247949800/0x7645c8e1169f9c40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9c47 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951338.977327:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945023872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783951338.977356:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951338.977373:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e036d3a0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783951338.977509:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945023872 00000100:00100000:0.0:1783951338.977514:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945023872 00000100:00100000:0.0:1783951338.977546:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783951338.977554:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+20:22774:x1870607945023872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783951338.977569:0:22772:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783951338.977585:0:22772:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783951338.977588:0:22772:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1783951338.977682:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+20:22774:x1870607945023872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951338.977697:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783951338.978221:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945023872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783951338.978305:0:22774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783951338.978312:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949800/0x7645c8e1169f9c40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9c47 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951338.978321:0:22774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247949800/0x7645c8e1169f9c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9c47 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951338.978330:0:22774:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783951338.978332:0:22774:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e037ca6d800 from 13 10000000:01000000:2.0:1783951338.978340:0:22774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783951338.978357:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949400/0x7645c8e1169f9c4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951338.978365:0:22774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247949400/0x7645c8e1169f9c4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951338.978373:0:22774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247949400/0x7645c8e1169f9c4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951338.978387:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945024000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783951338.978416:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951338.978440:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e035a104240 going to sleep for 11 seconds 00000100:00100000:0.0:1783951338.978598:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945024000 00000100:00100000:0.0:1783951338.978604:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945024000 00000100:00100000:0.0:1783951338.978639:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783951338.978646:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+20:22774:x1870607945024000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951338.978654:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951338.978663:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9c55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9c4e expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951338.978680:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9c55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9c4e expref: 21 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951338.978689:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9c55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9c4e expref: 21 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951338.978696:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2600, rc 0) 00000100:00100000:0.0:1783951338.978741:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+21:22774:x1870607945024000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951338.978748:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783951338.978818:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945024000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951338.978829:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247949400/0x7645c8e1169f9c4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9c55 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951338.978836:0:22774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247949400/0x7645c8e1169f9c4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9c55 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951338.978879:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945024128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783951338.978908:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951338.978948:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350e3ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1783951338.978998:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945024128 00000100:00100000:0.0:1783951338.979002:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945024128 00000100:00100000:0.0:1783951338.979029:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783951338.979036:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+21:22774:x1870607945024128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783951338.979048:0:22771:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783951338.979063:0:22771:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783951338.979065:0:22771:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1783951338.979134:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+21:22774:x1870607945024128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 98us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951338.979181:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783951338.979214:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945024128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783951338.979270:0:22774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783951338.979276:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949400/0x7645c8e1169f9c4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9c55 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951338.979283:0:22774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247949400/0x7645c8e1169f9c4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9c55 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951339.040858:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951340.065555:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783951340.512897:0:22812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783951341.090346:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951342.112524:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951342.176473:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783951342.176497:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945024256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951342.176566:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951342.176617:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945024256 00000100:00100000:1.0:1783951342.176624:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945024256 00000100:00100000:1.0:1783951342.176669:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783951342.176677:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607945024256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783951342.176726:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783951342.176772:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607945024256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951342.176780:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783951342.176826:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945024256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783951342.177109:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951342.177120:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945024384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951342.177164:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951342.177215:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945024384 00000100:00100000:3.0:1783951342.177219:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945024384 00000100:00100000:3.0:1783951342.177242:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783951342.177249:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945024384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783951342.177279:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783951342.177313:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945024384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951342.177326:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783951342.177359:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945024384:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1783951342.181193:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951342.181199:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951342.181202:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951342.181204:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951342.181216:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951342.181219:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951342.181221:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951342.181223:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783951342.181351:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607945024640:0@lo:400:kworker.0 00000100:00100000:1.0:1783951342.181419:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951342.181455:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783951342.181462:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b1b2cfa-7097-4258-904b-0084ac551497:3653:1870607945024512:0@lo:400:kworker.0 00000100:00100000:1.0:1783951342.181487:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951342.181513:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607945025024:0@lo:400:kworker.0 00000100:00100000:1.0:1783951342.181532:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951342.181563:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945024640 00000100:00100000:1.0:1783951342.181570:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945024640 00000100:00100000:1.0:1783951342.181605:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945025024 00000100:00100000:1.0:1783951342.181615:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945025024 00000100:00100000:1.0:1783951342.181643:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783951342.181651:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607945024640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951342.181699:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607945024640:12345-0@lo:400:kworker.0 Request processed in 48us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951342.181707:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783951342.181722:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783951342.181727:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607945025024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951342.181752:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607945025024:12345-0@lo:400:kworker.0 Request processed in 25us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951342.181757:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783951342.181774:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945024512 00000100:00100000:1.0:1783951342.181778:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945024512 00000100:00100000:1.0:1783951342.181802:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783951342.181806:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+21:3653:x1870607945024512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951342.181832:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+21:3653:x1870607945024512:12345-0@lo:400:kworker.0 Request processed in 26us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951342.181839:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783951342.181875:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607945024768:0@lo:400:kworker.0 00000100:00100000:1.0:1783951342.181898:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951342.181916:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951342.181921:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607945024896:0@lo:400:kworker.0 00000100:00100000:1.0:1783951342.181944:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951342.181964:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945024768 00000100:00100000:1.0:1783951342.181967:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945024768 00000100:00100000:1.0:1783951342.181985:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945024896 00000100:00100000:1.0:1783951342.181988:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945024896 00000100:00100000:1.0:1783951342.182013:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783951342.182018:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607945024768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951342.182051:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607945024768:12345-0@lo:400:kworker.0 Request processed in 33us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951342.182057:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783951342.182070:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783951342.182075:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607945024896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951342.182100:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1870607945024896:12345-0@lo:400:kworker.0 Request processed in 26us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951342.182106:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1783951342.182167:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02483a1f80 x1870607945024896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951342.182181:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3654:1870607945024896:0@lo:400:kworker.0 00010000:00080000:1.0:1783951342.182191:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02483a0380 x1870607945024768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951342.182198:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607945024768:0@lo:400:kworker.0 00000100:00100000:1.0:1783951342.182223:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b1b2cfa-7097-4258-904b-0084ac551497:3653:1870607945024512:0@lo:400:kworker.0 00010000:00080000:1.0:1783951342.182232:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02483a0000 x1870607945025024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951342.182238:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607945025024:0@lo:400:kworker.0 00010000:00080000:1.0:1783951342.182247:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02483a1c00 x1870607945024640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951342.182253:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607945024640:0@lo:400:kworker.0 00000100:00080000:3.0:1783951342.184362:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783951342.184372:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:0.0:1783951343.112495:0:24647:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783951343.136383:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783951343.265815:0:23527:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1783951344.060657:0:24699:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783951344.060903:0:24699:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783951344.163384:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783951345.066171:0:24750:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783951345.066716:0:24750:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783951345.184532:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951346.144341:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951331/real 1783951331] req@ffff9e02483a2680 x1870607945018496/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951346 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951346.144377:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e02483a2680 x1870607945018496/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951346 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951346.144388:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951331/real 1783951331] req@ffff9e037e424700 x1870607945018752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951346 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951346.144399:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e037e424700 x1870607945018752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951346 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951346.144420:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246426800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951346.144455:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783951346.144459:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945018496:0@lo:8:kworker.0 00000100:00080000:2.0:1783951346.144490:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246426000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951346.144496:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783951346.144508:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945018752:0@lo:8:kworker.0 00000100:00080000:0.0:1783951346.144704:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951346.144710:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783951346.144712:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951346.144716:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783951346.144733:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951346.144737:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783951346.144740:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e0246426000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951346.144745:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 687 00000100:00080000:0.0:1783951346.144751:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783951346.144758:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e0246426000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783951346.144781:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037e424000 x1870607945025664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951346.144806:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951346.144809:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783951346.144811:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e0246426800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951346.144814:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 687 00000100:00080000:0.0:1783951346.144817:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783951346.144820:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e0246426800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783951346.144833:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037e425c00 x1870607945025792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951346.144844:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b1b2cfa-7097-4258-904b-0084ac551497:3653:1870607945025152:0@lo:400:kworker.0 00000100:00100000:1.0:1783951346.144931:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951346.144936:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945025536:0@lo:400:kworker.0 00000100:00100000:1.0:1783951346.144988:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607945025920:0@lo:400:kworker.0 00000100:00100000:2.0:1783951346.144994:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951346.145023:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951346.145056:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945025536 00000100:00100000:1.0:1783951346.145061:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607945025408:0@lo:400:kworker.0 00000100:00100000:2.0:1783951346.145066:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945025536 00000100:00100000:1.0:1783951346.145086:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951346.145123:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783951346.145132:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945025536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951346.145216:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945025536:12345-0@lo:400:kworker.0 Request processed in 85us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951346.145223:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783951346.145273:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945025536:0@lo:400:kworker.0 00000100:00100000:2.0:1783951346.145295:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945025664:0@lo:8:kworker.0 00000100:00100000:1.0:1783951346.145303:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607945026176:0@lo:400:kworker.0 00000100:00100000:2.0:1783951346.145330:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951346.145337:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951346.145364:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945025792:0@lo:8:kworker.0 00000100:00100000:1.0:1783951346.145364:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783951346.145374:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607945025280:0@lo:400:kworker.0 00000100:00100000:2.0:1783951346.145401:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951346.145418:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951346.145441:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607945026048:0@lo:400:kworker.0 00000100:00100000:1.0:1783951346.145458:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951346.145485:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945025920 00000100:00100000:1.0:1783951346.145488:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945025920 00000100:00100000:1.0:1783951346.145508:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945025408 00000100:00100000:1.0:1783951346.145510:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945025408 00000100:00100000:1.0:1783951346.145519:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945026176 00000100:00100000:1.0:1783951346.145521:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945026176 00000100:00100000:1.0:1783951346.145546:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945026048 00000100:00100000:1.0:1783951346.145548:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945026048 00000100:00100000:1.0:1783951346.145561:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783951346.145566:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607945025920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951346.145599:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607945025920:12345-0@lo:400:kworker.0 Request processed in 33us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951346.145605:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783951346.145625:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783951346.145630:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607945025408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951346.145656:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607945025408:12345-0@lo:400:kworker.0 Request processed in 26us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951346.145662:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783951346.145671:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783951346.145676:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607945026176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951346.145696:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607945026176:12345-0@lo:400:kworker.0 Request processed in 20us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951346.145701:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783951346.145709:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783951346.145714:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607945026048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951346.145732:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607945026048:12345-0@lo:400:kworker.0 Request processed in 18us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951346.145748:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783951346.145768:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945025280 00000100:00080000:2.0:1783951346.145866:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783951346.145872:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951346.145931:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945025152 00000100:00100000:0.0:1783951346.145936:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945025152 00000100:00100000:0.0:1783951346.145978:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783951346.145985:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+21:3653:x1870607945025152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951346.146027:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+21:3653:x1870607945025152:12345-0@lo:400:kworker.0 Request processed in 42us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951346.146034:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783951346.146067:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945025664 00000100:00100000:0.0:1783951346.146071:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945025664 00000100:00100000:0.0:1783951346.146094:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945025792 00000100:00100000:0.0:1783951346.146097:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945025792 00000100:00100000:0.0:1783951346.146108:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951346.146113:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3651:x1870607945025664:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783951346.146172:0:24281:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 701 last 0 00000020:00000080:0.0:1783951346.146200:0:24281:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f9c5c 00002000:00100000:0.0:1783951346.146212:0:24281:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9e0247afa000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1783951346.146217:0:24281:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1783951346.146227:0:24281:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783951346.146413:0:24281:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1783951346.146437:0:24281:0:(import.c:65:import_set_state_nolock()) ffff9e0247afb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951346.146481:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1870607945025664:12345-0@lo:8:kworker.0 Request processed in 367us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951346.146488:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951346.146502:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783951346.146506:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3651:x1870607945025792:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1783951346.146518:0:24281:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951346.147071:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945025280 00000100:00100000:1.0:1783951346.147128:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783951346.147137:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607945025280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951346.147195:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607945025280:12345-0@lo:400:kworker.0 Request processed in 60us (1778us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951346.147202:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1783951346.147258:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037e426a00 x1870607945025920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951346.147272:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607945025920:0@lo:400:kworker.0 00000100:00100000:1.0:1783951346.147302:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b1b2cfa-7097-4258-904b-0084ac551497:3653:1870607945025152:0@lo:400:kworker.0 00000100:00100000:1.0:1783951346.147340:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607945025280:0@lo:400:kworker.0 00010000:00080000:1.0:1783951346.147352:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037e424380 x1870607945026048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951346.147360:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607945026048:0@lo:400:kworker.0 00010000:00080000:1.0:1783951346.147371:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037e427b80 x1870607945025408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951346.147378:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607945025408:0@lo:400:kworker.0 00010000:00080000:1.0:1783951346.147387:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037e425180 x1870607945026176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951346.147394:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607945026176:0@lo:400:kworker.0 00010000:00080000:2.0:1783951346.147457:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037e424000 x1870607945025664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783951366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951346.147467:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783951346.147474:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1783951346.147482:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783951346.147488:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783951346.147498:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246426000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783951346.147528:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783951346.147534:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945025664:0@lo:8:kworker.0 00000004:00080000:3.0:1783951346.147630:0:23518:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1783951346.147652:0:23518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23518:1870607945026432:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1783951346.147684:0:23518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951346.147716:0:23518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350e3e000 going to sleep for 11 seconds 00000100:00100000:3.0:1783951346.147733:0:24283:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1783951346.147739:0:24283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1783951346.147850:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945026432 00000100:00100000:3.0:1783951346.147855:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945026432 00000100:00100000:3.0:1783951346.147956:0:24810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783951346.147973:0:24810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23518:x1870607945026432:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1783951346.148484:0:23517:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783951346.148578:0:23517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 701796435261ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783951346.148586:0:23517:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1783951346.148619:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951346.148633:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945026304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951346.148674:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783951346.148756:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1783951346.152478:0:24810:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1783951346.152487:0:24810:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1783951346.152585:0:24810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23518:x1870607945026432:12345-0@lo:7:osp-pre-0-1.0 Request processed in 4616us (4894us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951346.152610:0:24810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:2.0:1783951346.153135:0:23509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:3.0:1783951346.154104:0:23518:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037fc66680 x1870607945026432/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783951362 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951346.154121:0:23518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23518:1870607945026432:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1783951346.154157:0:23518:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1783951346.154204:0:23518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23518:1870607945026560:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1783951346.154316:0:23518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951346.154362:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945026560 00000100:00100000:2.0:1783951346.154369:0:23518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350e3e000 going to sleep for 11 seconds 00000100:00100000:3.0:1783951346.154370:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945026560 00000100:00100000:3.0:1783951346.154433:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783951346.154441:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23518:x1870607945026560:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1783951346.154470:0:24283:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1783951346.154529:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23518:x1870607945026560:12345-0@lo:5:osp-pre-0-1.0 Request processed in 88us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951346.154537:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783951346.154572:0:23518:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037fc66680 x1870607945026560/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783951362 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951346.154584:0:23518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23518:1870607945026560:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1783951346.154594:0:23518:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1783951346.164049:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945026304 00000100:00100000:1.0:1783951346.164064:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945026304 00000100:00100000:1.0:1783951346.164175:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783951346.164187:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0342e82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1870607945026304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783951346.164224:0:24284:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783951346.164340:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0342e82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1870607945026304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 144us (15653us total) trans 0 rc 0/0 00010000:00080000:3.0:1783951346.164375:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037fc67480 x1870607945026304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951346.164398:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945026304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951346.164474:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951346.170609:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3651:x1870607945025792:12345-0@lo:8:kworker.0 Request processed in 24093us (25201us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951346.170623:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1783951346.170698:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246426800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951346.170705:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951346.170709:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945025792:0@lo:8:kworker.0 00010000:00010000:3.0:1783951346.208756:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951347.233067:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951347.298525:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951347.298560:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945026688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951347.298662:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951347.299042:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945026688 00000100:00100000:1.0:1783951347.299054:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945026688 00000100:00100000:1.0:1783951347.299119:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783951347.299129:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945026688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783951347.299194:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783951347.299268:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945026688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951347.299276:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783951347.302644:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945026816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951347.302745:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951347.302847:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945026816 00000100:00100000:0.0:1783951347.302856:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945026816 00000100:00100000:0.0:1783951347.302915:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783951347.302926:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945026816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783951347.302976:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783951347.303032:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945026816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951347.303041:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783951347.303101:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945026816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951347.306111:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945026688:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783951348.258015:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951349.283111:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951350.304611:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783951350.758866:0:22812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783951351.329245:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951351.397750:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945026944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783951351.397821:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951351.397911:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945026944 00000100:00100000:0.0:1783951351.397918:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945026944 00000100:00100000:0.0:1783951351.397968:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783951351.397977:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1870607945026944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783951351.398007:0:24285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783951351.398054:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1870607945026944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951351.398061:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1783951351.398079:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783951351.398107:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037e427100 x1870607945026944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951351.398125:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945026944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783951351.398193:0:23518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23518:1870607945027072:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1783951351.398221:0:23518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951351.398244:0:23518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03432b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951351.398807:0:24810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945027072 00000100:00100000:3.0:1783951351.398812:0:24810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945027072 00000100:00100000:3.0:1783951351.398845:0:24810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783951351.398854:0:24810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23518:x1870607945027072:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1783951351.398888:0:24810:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00080000:1.0:1783951351.399309:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951351.399314:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951351.399317:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951351.399320:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951351.399345:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951351.399348:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783951351.399352:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e0246426800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951351.399357:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 701 00000100:00080000:1.0:1783951351.399361:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783951351.399366:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e0246426800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951351.399388:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e02483a1f80 x1870607945027712/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951351.399558:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b1b2cfa-7097-4258-904b-0084ac551497:3652:1870607945027200:0@lo:400:kworker.0 00000100:00100000:1.0:1783951351.399602:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951351.399642:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607945027840:0@lo:400:kworker.0 00000100:00100000:1.0:1783951351.399667:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951351.399687:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783951351.399693:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945027328:0@lo:400:kworker.0 00000100:00100000:1.0:1783951351.399716:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951351.399733:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607945027968:0@lo:400:kworker.0 00000100:00100000:1.0:1783951351.399750:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951351.399772:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607945027456:0@lo:400:kworker.0 00000100:00100000:1.0:1783951351.399793:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951351.399808:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607945028096:0@lo:400:kworker.0 00000100:00100000:1.0:1783951351.399826:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951351.399835:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951351.399840:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945027584:0@lo:400:kworker.0 00000100:00100000:1.0:1783951351.399857:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951351.399882:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e02483a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945027712:0@lo:8:kworker.0 00000100:00100000:1.0:1783951351.399908:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951351.399934:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945027200 00000100:00100000:1.0:1783951351.399938:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945027200 00000100:00100000:1.0:1783951351.399971:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783951351.399978:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+21:3652:x1870607945027200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951351.400018:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+21:3652:x1870607945027200:12345-0@lo:400:kworker.0 Request processed in 40us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951351.400024:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783951351.400052:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945027840 00000100:00100000:1.0:1783951351.400056:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945027840 00000100:00100000:1.0:1783951351.400073:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945027968 00000100:00100000:1.0:1783951351.400080:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945027968 00000100:00100000:1.0:1783951351.400103:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945027456 00000100:00100000:1.0:1783951351.400105:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945027456 00000100:00100000:1.0:1783951351.400116:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945028096 00000100:00100000:1.0:1783951351.400118:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945028096 00000100:00100000:1.0:1783951351.400130:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783951351.400136:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607945027840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951351.400203:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607945027840:12345-0@lo:400:kworker.0 Request processed in 67us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951351.400210:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783951351.400222:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783951351.400229:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607945027968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951351.400255:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607945027968:12345-0@lo:400:kworker.0 Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951351.400260:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783951351.400271:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783951351.400277:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607945027456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951351.400306:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1870607945027456:12345-0@lo:400:kworker.0 Request processed in 30us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951351.400312:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783951351.400322:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783951351.400328:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607945028096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951351.400354:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607945028096:12345-0@lo:400:kworker.0 Request processed in 26us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951351.400359:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783951351.400376:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945027328 00000100:00100000:1.0:1783951351.400380:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945027328 00000100:00100000:1.0:1783951351.400402:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945027584 00000100:00100000:1.0:1783951351.400405:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945027584 00000100:00100000:1.0:1783951351.400417:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783951351.400421:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607945027328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951351.400466:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607945027328:12345-0@lo:400:kworker.0 Request processed in 43us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951351.400472:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783951351.400484:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783951351.400490:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945027584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951351.400514:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945027584:12345-0@lo:400:kworker.0 Request processed in 24us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951351.400519:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783951351.400561:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945027328:0@lo:400:kworker.0 00010000:00080000:1.0:1783951351.400574:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037d247100 x1870607945027968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951351.400585:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607945027968:0@lo:400:kworker.0 00000100:00100000:1.0:1783951351.400594:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b1b2cfa-7097-4258-904b-0084ac551497:3652:1870607945027200:0@lo:400:kworker.0 00010000:00080000:1.0:1783951351.400602:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02483a2680 x1870607945027840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951351.400610:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607945027840:0@lo:400:kworker.0 00000100:00080000:1.0:1783951351.400635:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951351.400639:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951351.400654:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945027584:0@lo:400:kworker.0 00010000:00080000:1.0:1783951351.400664:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e02483a3800 x1870607945027456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951351.400679:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3654:1870607945027456:0@lo:400:kworker.0 00010000:00080000:1.0:1783951351.400691:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037d246680 x1870607945028096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951351.400699:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037d246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607945028096:0@lo:400:kworker.0 00000100:00100000:3.0:1783951351.400899:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945027712 00000100:00100000:3.0:1783951351.400904:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945027712 00000100:00100000:3.0:1783951351.400929:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783951351.400933:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3651:x1870607945027712:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1783951351.400951:0:24283:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951351.401002:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3651:x1870607945027712:12345-0@lo:8:kworker.0 Request processed in 67us (1093us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951351.401009:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1783951351.401037:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246426800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951351.401042:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783951351.401046:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e02483a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945027712:0@lo:8:kworker.0 00000001:00080000:2.0:1783951351.439598:0:24277:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1783951351.439614:0:24277:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1783951351.440070:0:24810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23518:x1870607945027072:12345-0@lo:5:osp-pre-0-1.0 Request processed in 41207us (41837us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1783951351.440086:0:24810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1783951351.441574:0:23518:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037e427100 x1870607945027072/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783951367 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951351.441592:0:23518:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1783951351.441601:0:23518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23518:1870607945027072:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1783951351.441622:0:23518:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1783951351.441695:0:23518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23518:1870607945028224:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1783951351.441757:0:23518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951351.441799:0:23518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03432b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951351.441888:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945028224 00000100:00100000:3.0:1783951351.441896:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945028224 00000100:00100000:3.0:1783951351.441952:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783951351.441961:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23518:x1870607945028224:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1783951351.442138:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23518:x1870607945028224:12345-0@lo:900:osp-pre-0-1.0 Request processed in 177us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951351.442169:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783951351.446885:0:23518:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037e427100 x1870607945028224/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783951367 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951351.446913:0:23518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23518:1870607945028224:0@lo:900:osp-pre-0-1.0 00000020:01000004:0.0:1783951351.547090:0:25096:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783951351.547095:0:25096:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1783951351.547097:0:25096:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1783951351.547519:0:25096:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e0247afd000 00000020:01000004:0.0:1783951351.547563:0:25096:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1783951351.547585:0:25096:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783951351.547607:0:25096:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e0246b44d40) 00000020:00000080:0.0:1783951351.547631:0:25096:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783951351.619008:0:25096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783951351.625234:0:25096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783951351.627036:0:25096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783951351.627317:0:25096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1783951351.627640:0:25096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1783951351.627852:0:25096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1783951351.628081:0:25096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1783951351.629597:0:25096:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783951351.629825:0:25096:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783951351.629840:0:25096:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783951351.629852:0:25096:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7645c8e1169f9c6a 00000020:01000004:3.0:1783951351.629860:0:25096:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1783951351.629883:0:25096:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.133@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783951351.629887:0:25096:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783951351.629895:0:25096:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783951351.630004:0:25096:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1783951351.630010:0:25096:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.133@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1783951351.645661:0:25096:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783951351.645700:0:25096:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.133@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1783951351.645705:0:25096:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783951351.645707:0:25096:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783951351.645709:0:25096:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951351.645710:0:25096:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951351.645711:0:25096:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951351.645713:0:25096:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951351.645714:0:25096:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783951351.645716:0:25096:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951351.645720:0:25096:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783951351.645723:0:25096:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1783951351.645726:0:25096:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783951351.645727:0:25096:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783951351.645728:0:25096:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951351.645729:0:25096:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951351.645730:0:25096:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951351.645731:0:25096:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951351.645732:0:25096:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783951351.645733:0:25096:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951351.645734:0:25096:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783951351.645758:0:25096:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783951351.645775:0:25096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945028352:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783951351.645843:0:25096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951351.645934:0:25096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03492a30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951351.651889:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945028352 00000100:00100000:2.0:1783951351.651906:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945028352 00000100:00100000:2.0:1783951351.651993:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783951351.652004:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+21:25096:x1870607945028352:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783951351.652059:0:22771:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1783951351.652063:0:22771:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1783951351.652067:0:22771:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1783951351.653358:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+21:25096:x1870607945028352:12345-0@lo:253:mount.lustre.0 Request processed in 1351us (7510us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951351.653369:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783951351.653475:0:25096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945028352:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783951351.653489:0:25096:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783951351.653493:0:25096:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783951351.653495:0:25096:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783951351.653496:0:25096:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951351.653497:0:25096:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951351.653499:0:25096:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951351.653500:0:25096:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951351.653501:0:25096:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783951351.653504:0:25096:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951351.653505:0:25096:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783951351.653531:0:25096:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e0247afd000 from lustre-OST0001 10000000:01000000:0.0:1783951351.653563:0:25096:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1783951351.653566:0:25096:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783951351.653575:0:25096:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e037795b380 local copy 00010000:00010000:0.0:1783951351.653586:0:25096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f9984 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f998b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951351.653691:0:25096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945028480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951351.653728:0:25096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951351.653789:0:25096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413480 going to sleep for 11 seconds 00000100:00100000:2.0:1783951351.653848:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945028480 00000100:00100000:2.0:1783951351.653853:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945028480 00000100:00100000:2.0:1783951351.653934:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783951351.653943:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+21:25096:x1870607945028480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951351.654011:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+21:25096:x1870607945028480:12345-0@lo:501:mount.lustre.0 Request processed in 70us (284us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783951351.654019:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783951351.658226:0:25096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945028480:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783951351.658257:0:25096:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783951351.658316:0:25096:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783951351.658326:0:25096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f9984 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f998b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951351.658336:0:25096:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3000/0x7645c8e1169f9984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f998b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951351.658370:0:25096:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e0247afd000 10000000:01000000:0.0:1783951351.658376:0:25096:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783951351.658382:0:25096:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783951351.658384:0:25096:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783951351.658389:0:25096:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1783951351.658391:0:25096:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783951351.658426:0:25096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2400/0x7645c8e1169f9c71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951351.658433:0:25096:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2400/0x7645c8e1169f9c71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951351.658444:0:25096:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2400/0x7645c8e1169f9c71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951351.658466:0:25096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945028608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951351.658524:0:25096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951351.658563:0:25096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413480 going to sleep for 11 seconds 00000100:00100000:1.0:1783951351.658698:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945028608 00000100:00100000:1.0:1783951351.658704:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945028608 00000100:00100000:1.0:1783951351.658769:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783951351.658779:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+21:25096:x1870607945028608:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951351.658792:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951351.658805:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03413c2a00/0x7645c8e1169f9c78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9c71 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951351.658827:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03413c2a00/0x7645c8e1169f9c78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9c71 expref: 22 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951351.658837:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03413c2a00/0x7645c8e1169f9c78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9c71 expref: 22 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951351.658846:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03413c2a00, rc 0) 00000100:00100000:1.0:1783951351.658896:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+22:25096:x1870607945028608:12345-0@lo:101:mount.lustre.0 Request processed in 118us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951351.658902:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783951351.658988:0:25096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945028608:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951351.659001:0:25096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2400/0x7645c8e1169f9c71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9c78 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.659009:0:25096:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2400/0x7645c8e1169f9c71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9c78 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783951351.660586:0:25096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1783951351.661299:0:25096:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783951351.664610:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1783951351.664674:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1783951351.664692:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1783951351.664717:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1783951351.664745:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1783951351.664763:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1783951351.664778:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1783951351.664792:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1783951351.664805:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1783951351.664845:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1783951351.664852:0:25096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1783951351.664976:0:25096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945028736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951351.665054:0:25096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951351.665132:0:25096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03492a30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951351.665422:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945028736 00000100:00100000:1.0:1783951351.665431:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945028736 00000100:00100000:1.0:1783951351.665489:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783951351.665499:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+22:25096:x1870607945028736:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951351.665673:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+22:25096:x1870607945028736:12345-0@lo:501:mount.lustre.0 Request processed in 174us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951351.665682:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783951351.666308:0:25096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945028736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951351.666352:0:25096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945028864:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951351.666409:0:25096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951351.666492:0:25096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03492a30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951351.666567:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945028864 00000100:00100000:2.0:1783951351.666579:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945028864 00000100:00100000:2.0:1783951351.669094:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783951351.669107:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+22:25096:x1870607945028864:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951351.670397:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+22:25096:x1870607945028864:12345-0@lo:503:mount.lustre.0 Request processed in 1285us (3981us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951351.670409:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783951351.670527:0:25096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945028864:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783951351.671002:0:25096:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783951351.671100:0:25096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945028992:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783951351.671204:0:25096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951351.671246:0:25096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03492a3600 going to sleep for 11 seconds 00000100:00100000:0.0:1783951351.671787:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945028992 00000100:00100000:0.0:1783951351.671803:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945028992 00000100:00100000:0.0:1783951351.671854:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783951351.671863:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+22:25096:x1870607945028992:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951351.672659:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+22:25096:x1870607945028992:12345-0@lo:502:mount.lustre.0 Request processed in 795us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951351.672668:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783951351.677461:0:25096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945028992:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783951351.678129:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1783951351.678854:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1783951351.678878:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1783951351.678894:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1783951351.678909:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1783951351.678923:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1783951351.678938:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1783951351.678953:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1783951351.678967:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1783951351.679018:0:25096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945029120:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951351.679099:0:25096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951351.679201:0:25096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413300 going to sleep for 11 seconds 00000100:00100000:2.0:1783951351.679359:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945029120 00000100:00100000:2.0:1783951351.679367:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945029120 00000100:00100000:2.0:1783951351.679422:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783951351.679432:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+22:25096:x1870607945029120:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951351.679569:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+22:25096:x1870607945029120:12345-0@lo:502:mount.lustre.0 Request processed in 138us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951351.679577:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783951351.679874:0:25096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945029120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783951351.679941:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1783951351.679952:0:25096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1783951351.680621:0:25100:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783951351.680630:0:25100:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1783951351.680637:0:25100:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951351.680639:0:25100:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1783951351.680645:0:25100:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783951351.680660:0:25100:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e036c2e4d40) 00000020:00000080:1.0:1783951351.680685:0:25100:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783951351.680693:0:25100:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783951351.680856:0:25100:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0247afd000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1783951351.680866:0:25100:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783951351.680874:0:25100:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7645c8e1169f9c86 00010000:00010000:1.0:1783951351.689892:0:25100:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1783951351.691610:0:25100:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:1.0:1783951351.693308:0:25100:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1783951351.698757:0:25100:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1783951351.698770:0:25100:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951351.698777:0:25100:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951351.698779:0:25100:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1783951351.698783:0:25100:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951351.698787:0:25100:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951351.698788:0:25100:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783951351.698792:0:25100:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783951351.698794:0:25100:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783951351.698796:0:25100:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951351.698807:0:25100:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951351.698808:0:25100:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783951351.698811:0:25100:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783951351.698814:0:25100:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951351.698816:0:25100:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783951351.698820:0:25100:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1783951351.698854:0:25100:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951351.698857:0:25100:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951351.698859:0:25100:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783951351.698862:0:25100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1783951351.701280:0:25096:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1783951351.701328:0:25096:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783951351.701353:0:25096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2400/0x7645c8e1169f9c71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9c78 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951351.701367:0:25096:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2400/0x7645c8e1169f9c71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9c78 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951351.701388:0:25096:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0247afd000 from 1 10000000:01000000:0.0:1783951351.701391:0:25096:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783951351.701437:0:25096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2200/0x7645c8e1169f9c8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951351.701463:0:25096:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2200/0x7645c8e1169f9c8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951351.701475:0:25096:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2200/0x7645c8e1169f9c8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951351.701503:0:25096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945029248:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951351.701571:0:25096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951351.701627:0:25096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413480 going to sleep for 11 seconds 00000100:00100000:1.0:1783951351.703228:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945029248 00000100:00100000:1.0:1783951351.703238:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945029248 00000100:00100000:0.0:1783951351.704128:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783951351.704169:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+22:25096:x1870607945029248:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951351.704195:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951351.704214:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e037d2b3a00/0x7645c8e1169f9c94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9c8d expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951351.704243:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e037d2b3a00/0x7645c8e1169f9c94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9c8d expref: 23 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951351.704254:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e037d2b3a00/0x7645c8e1169f9c94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9c8d expref: 23 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951351.704264:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3a00, rc 0) 00000100:00100000:0.0:1783951351.704346:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+23:25096:x1870607945029248:12345-0@lo:101:mount.lustre.0 Request processed in 207us (2773us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951351.704353:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783951351.704465:0:25096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945029248:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951351.704483:0:25096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2200/0x7645c8e1169f9c8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9c94 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951351.704494:0:25096:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2200/0x7645c8e1169f9c8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9c94 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783951351.706093:0:25096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1783951351.706425:0:25096:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783951351.706617:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1783951351.706648:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1783951351.706665:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1783951351.706696:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1783951351.706715:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1783951351.706730:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1783951351.706747:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1783951351.706762:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1783951351.706778:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1783951351.706793:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1783951351.706808:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1783951351.706837:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1783951351.706842:0:25096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1783951351.706917:0:25096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945029376:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951351.707380:0:25096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951351.717215:0:25096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0371c7c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951351.724024:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945029376 00000100:00100000:3.0:1783951351.724037:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945029376 00000100:00100000:3.0:1783951351.724089:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783951351.724099:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+23:25096:x1870607945029376:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951351.724320:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+23:25096:x1870607945029376:12345-0@lo:501:mount.lustre.0 Request processed in 222us (16940us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951351.724328:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783951351.725541:0:25096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945029376:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951351.725604:0:25096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945029504:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951351.725672:0:25096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951351.725704:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945029504 00000100:00100000:0.0:1783951351.725712:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945029504 00000100:00100000:1.0:1783951351.725830:0:25096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0371c7c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951351.726267:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783951351.726278:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+23:25096:x1870607945029504:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951351.726402:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+23:25096:x1870607945029504:12345-0@lo:503:mount.lustre.0 Request processed in 125us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951351.726409:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783951351.726456:0:25096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945029504:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783951351.726904:0:25096:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783951351.727000:0:25096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945029632:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951351.727054:0:25096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951351.734230:0:25096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413600 going to sleep for 11 seconds 00000100:00100000:2.0:1783951351.734793:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945029632 00000100:00100000:2.0:1783951351.734804:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945029632 00000100:00100000:2.0:1783951351.734860:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783951351.734871:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+23:25096:x1870607945029632:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951351.735189:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+23:25096:x1870607945029632:12345-0@lo:502:mount.lustre.0 Request processed in 310us (8125us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951351.735197:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783951351.736541:0:25096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945029632:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783951351.737381:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1783951351.737423:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1783951351.737441:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1783951351.737458:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1783951351.737472:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1783951351.737487:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1783951351.737501:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1783951351.737515:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1783951351.737531:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1783951351.737545:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1783951351.737562:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1783951351.737605:0:25096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945029760:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951351.737868:0:25096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951351.738489:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945029760 00000100:00100000:2.0:1783951351.738497:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945029760 00000100:00100000:2.0:1783951351.738563:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783951351.738572:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+23:25096:x1870607945029760:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783951351.738821:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+23:25096:x1870607945029760:12345-0@lo:502:mount.lustre.0 Request processed in 249us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951351.738838:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783951351.738891:0:25096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413600 going to sleep for 11 seconds 00000100:00100000:0.0:1783951351.738913:0:25096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945029760:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783951351.739063:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1783951351.739082:0:25096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1783951351.742865:0:25104:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951351.742877:0:25104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951351.742879:0:25104:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783951351.742886:0:25104:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0247afd000 00000020:00000080:2.0:1783951351.742889:0:25104:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783951351.742896:0:25104:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951351.742899:0:25104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951351.742901:0:25104:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783951351.742904:0:25104:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951351.742906:0:25104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951351.742907:0:25104:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783951351.742911:0:25104:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0247afd000 00000020:00000080:2.0:1783951351.742913:0:25104:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783951351.742988:0:25104:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951351.748673:0:25104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951351.748692:0:25104:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783951351.748703:0:25104:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951351.748718:0:25104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951351.748720:0:25104:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783951351.748725:0:25104:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e0247afd000 00000020:00000080:3.0:1783951351.748728:0:25104:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783951351.748779:0:25104:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951351.748783:0:25104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951351.748784:0:25104:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783951351.748786:0:25104:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951351.748788:0:25104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951351.748790:0:25104:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783951351.748793:0:25104:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e0247afd000 00000020:00000080:3.0:1783951351.748795:0:25104:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783951351.748844:0:25104:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951351.748848:0:25104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951351.748850:0:25104:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783951351.748854:0:25104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1783951351.748957:0:25096:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783951351.748994:0:25096:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783951351.749012:0:25096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2200/0x7645c8e1169f9c8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9c94 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951351.749096:0:25096:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2200/0x7645c8e1169f9c8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9c94 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951351.749204:0:25096:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783951351.749208:0:25096:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e0247afd000 10000000:01000000:0.0:1783951351.749212:0:25096:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e0247afd000 10000000:01000000:0.0:1783951351.749217:0:25096:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783951351.749223:0:25096:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e0247afd000 from 1 10000000:01000000:0.0:1783951351.749226:0:25096:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783951351.749269:0:25096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f9c9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951351.749278:0:25096:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f9c9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951351.749289:0:25096:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f9c9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951351.749314:0:25096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945029888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951351.749383:0:25096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951351.749426:0:25096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413480 going to sleep for 11 seconds 00000100:00100000:3.0:1783951351.750248:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945029888 00000100:00100000:3.0:1783951351.750259:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945029888 00000100:00100000:3.0:1783951351.750326:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783951351.750336:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+23:25096:x1870607945029888:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951351.750352:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951351.750368:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03427e9000/0x7645c8e1169f9ca2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9c9b expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.750398:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03427e9000/0x7645c8e1169f9ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9c9b expref: 24 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.750410:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03427e9000/0x7645c8e1169f9ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9c9b expref: 24 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.750419:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03427e9000, rc 0) 00000100:00100000:3.0:1783951351.750517:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+24:25096:x1870607945029888:12345-0@lo:101:mount.lustre.0 Request processed in 182us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951351.750537:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783951351.752129:0:25096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945029888:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951351.752190:0:25096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f9c9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9ca2 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951351.752215:0:25096:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f9c9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9ca2 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783951351.755098:0:25096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1783951351.755441:0:25096:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951351.755637:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1783951351.755673:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1783951351.755693:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1783951351.755707:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1783951351.755722:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1783951351.757417:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1783951351.757466:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1783951351.757486:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1783951351.757507:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1783951351.757524:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1783951351.757540:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1783951351.757556:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1783951351.757572:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1783951351.757588:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1783951351.757606:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1783951351.757629:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1783951351.757647:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1783951351.757667:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1783951351.757687:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1783951351.757710:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1783951351.762568:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1783951351.762644:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1783951351.762666:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1783951351.762687:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1783951351.762706:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1783951351.762726:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1783951351.762769:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1783951351.762787:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1783951351.762808:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1783951351.762827:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1783951351.762844:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1783951351.762868:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1783951351.762893:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1783951351.762916:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1783951351.762935:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1783951351.762951:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1783951351.762970:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1783951351.762988:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1783951351.763008:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1783951351.763040:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1783951351.763064:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1783951351.763090:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1783951351.763113:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1783951351.763135:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1783951351.763212:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1783951351.763238:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1783951351.763262:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1783951351.763291:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1783951351.763496:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1783951351.763523:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1783951351.763546:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1783951351.763553:0:25096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1783951351.763689:0:25096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945030016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951351.763755:0:25096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951351.763803:0:25096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783951351.765022:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945030016 00000100:00100000:1.0:1783951351.765034:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945030016 00000100:00100000:1.0:1783951351.765221:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783951351.765232:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+24:25096:x1870607945030016:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951351.765401:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+24:25096:x1870607945030016:12345-0@lo:501:mount.lustre.0 Request processed in 170us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951351.765409:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783951351.770587:0:25096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945030016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951351.770652:0:25096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945030144:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951351.770747:0:25096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951351.770792:0:25096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e038118cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951351.770857:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945030144 00000100:00100000:0.0:1783951351.770863:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945030144 00000100:00100000:0.0:1783951351.770908:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783951351.770917:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+24:25096:x1870607945030144:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951351.771040:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+24:25096:x1870607945030144:12345-0@lo:503:mount.lustre.0 Request processed in 123us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951351.771048:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783951351.771112:0:25096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945030144:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783951351.771780:0:25096:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783951351.771859:0:25096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945030272:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951351.771906:0:25096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951351.771941:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945030272 00000100:00100000:0.0:1783951351.771946:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945030272 00000100:00100000:0.0:1783951351.771972:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783951351.771979:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+24:25096:x1870607945030272:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951351.772060:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+24:25096:x1870607945030272:12345-0@lo:502:mount.lustre.0 Request processed in 81us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951351.772067:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783951351.772118:0:25096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951351.772133:0:25096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945030272:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783951351.772343:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1783951351.772372:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1783951351.772389:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1783951351.772405:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1783951351.772435:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1783951351.772449:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1783951351.772483:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1783951351.772501:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1783951351.772514:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1783951351.772530:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1783951351.772546:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1783951351.772560:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1783951351.772576:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1783951351.772592:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1783951351.772609:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1783951351.772626:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1783951351.772642:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1783951351.772659:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1783951351.772675:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1783951351.772689:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1783951351.772705:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1783951351.772722:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1783951351.772753:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1783951351.772772:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1783951351.772789:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1783951351.772805:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1783951351.772824:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1783951351.772840:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1783951351.772854:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1783951351.772868:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1783951351.772881:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1783951351.772894:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1783951351.772909:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1783951351.772928:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1783951351.772943:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1783951351.772959:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1783951351.772973:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1783951351.772997:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1783951351.773027:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1783951351.773042:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1783951351.773054:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1783951351.773067:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1783951351.773080:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1783951351.773095:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1783951351.773110:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1783951351.773126:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1783951351.773162:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1783951351.773197:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1783951351.773240:0:25096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945030400:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951351.773291:0:25096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951351.773333:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945030400 00000100:00100000:0.0:1783951351.773339:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945030400 00000100:00100000:0.0:1783951351.773368:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783951351.773375:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+24:25096:x1870607945030400:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951351.773456:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+24:25096:x1870607945030400:12345-0@lo:502:mount.lustre.0 Request processed in 81us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951351.773463:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783951351.773500:0:25096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951351.773517:0:25096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945030400:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783951351.773639:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1783951351.773662:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1783951351.773682:0:25096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945030528:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951351.773720:0:25096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951351.773743:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945030528 00000100:00100000:0.0:1783951351.773747:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945030528 00000100:00100000:0.0:1783951351.773773:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783951351.773778:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+24:25096:x1870607945030528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783951351.773840:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+24:25096:x1870607945030528:12345-0@lo:502:mount.lustre.0 Request processed in 61us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951351.773846:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783951351.773875:0:25096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037e413480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951351.773888:0:25096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e424000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945030528:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783951351.773926:0:25096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1783951351.773934:0:25096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1783951351.783988:0:25109:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1783951351.784006:0:25109:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e036c2e19c0) 00000020:00000080:1.0:1783951351.784033:0:25109:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1783951351.784237:0:25109:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0247afd000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783951351.784243:0:25109:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0247afd000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783951351.784245:0:25109:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0247afd000 3 00010000:00080000:1.0:1783951351.784275:0:25109:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e02482a2800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.133@tcp at head 00010000:00010000:1.0:1783951351.785897:0:25109:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1783951351.786004:0:25109:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1783951351.786049:0:25109:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783951351.786063:0:25109:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7645c8e1169f9cb0 00000100:00080000:1.0:1783951351.786075:0:25109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783951351.786086:0:25109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e02482a2800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951351.786125:0:25109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0377abd500 x1870607945030656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951351.786199:0:25109:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783951351.786235:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951351.786240:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951351.786243:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951351.786246:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783951351.786598:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1870607945030656:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783951351.786671:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1783951351.787559:0:25109:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1783951351.787575:0:25109:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9e0246b43380) 00000020:00000080:0.0:1783951351.787596:0:25109:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1783951351.787755:0:25109:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0247afd000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783951351.787759:0:25109:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0247afd000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783951351.787762:0:25109:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0247afd000 3 00010000:00080000:0.0:1783951351.787790:0:25109:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0245b11000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.133@tcp at head 00010000:00010000:0.0:1783951351.789432:0:25109:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1783951351.789542:0:25109:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1783951351.789586:0:25109:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783951351.789601:0:25109:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x7645c8e1169f9cbe 00000100:00080000:0.0:1783951351.789612:0:25109:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783951351.789617:0:25109:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9e0245b11000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1783951351.789655:0:25109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e037e425180 x1870607945030784/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951351.789702:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3651:1870607945030784:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783951351.789773:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951351.789853:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945030656 00000100:00100000:0.0:1783951351.789862:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945030656 00000100:00100000:0.0:1783951351.789891:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945030784 00000100:00100000:0.0:1783951351.789895:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945030784 00000100:00100000:0.0:1783951351.789908:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783951351.789915:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1870607945030656:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783951351.789940:0:22777:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:0.0:1783951351.789972:0:22777:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7645c8e1169f9cc5 00000004:00100000:0.0:1783951351.789987:0:22777:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783951351.790020:0:22777:0:(import.c:65:import_set_state_nolock()) ffff9e02482a4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951351.790078:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1870607945030656:12345-0@lo:38:llog_process_th.0 Request processed in 162us (3407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951351.790087:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783951351.790102:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783951351.790106:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1870607945030784:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783951351.790122:0:22777:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:0.0:1783951351.790199:0:22777:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x7645c8e1169f9ccc 00000004:00100000:0.0:1783951351.790206:0:22777:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783951351.790225:0:22777:0:(import.c:65:import_set_state_nolock()) ffff9e02482a1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951351.790254:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1870607945030784:12345-0@lo:38:llog_process_th.0 Request processed in 146us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951351.790261:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783951351.790297:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e037e425180 x1870607945030784/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951351.790306:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783951351.790320:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1783951351.790327:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783951351.790331:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1783951351.790333:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0245b11000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783951351.790339:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3651:1870607945030784:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783951351.790354:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0377abd500 x1870607945030656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951351.790361:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783951351.790365:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1783951351.790370:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783951351.790373:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783951351.790375:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e02482a2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783951351.790380:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3651:1870607945030656:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1783951351.790402:0:25109:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783951351.790425:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951351.790430:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783951351.790433:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783951351.790436:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1783951351.811235:0:25109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1783951351.816848:0:25096:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1783951351.816895:0:25096:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783951351.816920:0:25096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f9c9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9ca2 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951351.816934:0:25096:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3200/0x7645c8e1169f9c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9ca2 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783951351.816993:0:25096:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783951351.816997:0:25096:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783951351.816998:0:25096:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951351.816999:0:25096:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951351.817000:0:25096:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951351.817002:0:25096:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951351.817004:0:25096:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783951351.817006:0:25096:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951351.817007:0:25096:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783951351.817010:0:25096:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1783951351.817012:0:25096:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783951351.817014:0:25096:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783951351.817015:0:25096:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951351.817016:0:25096:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951351.817021:0:25096:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951351.817022:0:25096:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951351.817022:0:25096:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783951351.817023:0:25096:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951351.817024:0:25096:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783951351.817051:0:25096:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783951351.817071:0:25096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945030912:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783951351.817782:0:25096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951351.817828:0:25096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0371c7c600 going to sleep for 11 seconds 00000100:00100000:0.0:1783951351.817950:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945030912 00000100:00100000:0.0:1783951351.817960:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945030912 00000100:00100000:0.0:1783951351.818007:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783951351.818015:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+24:25096:x1870607945030912:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783951351.818045:0:22771:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783951351.818064:0:22771:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783951351.828503:0:22771:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783951351.828557:0:22771:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1783951351.828912:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+24:25096:x1870607945030912:12345-0@lo:253:mount.lustre.0 Request processed in 10892us (11766us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951351.828924:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783951351.829053:0:25096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b1b2cfa-7097-4258-904b-0084ac551497:25096:1870607945030912:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783951351.829068:0:25096:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783951351.829072:0:25096:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783951351.829073:0:25096:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783951351.829075:0:25096:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951351.829076:0:25096:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951351.829077:0:25096:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951351.829078:0:25096:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951351.829080:0:25096:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783951351.829082:0:25096:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951351.829084:0:25096:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783951351.829098:0:25096:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1783951351.831542:0:22793:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783951351.831553:0:22793:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783951351.831576:0:22793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e0247949200/0x7645c8e1169f9cd3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951351.831596:0:22793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9c47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9c40 expref: 23 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951351.831603:0:22793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9c55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9c4e expref: 23 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951351.831611:0:22793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e0247949200/0x7645c8e1169f9cd3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951351.831653:0:22793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9c55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f9c4e expref: 23 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951351.831751:0:22793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9c55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f9c4e expref: 23 pid: 22769 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951351.831771:0:22793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22793:1870607945031040:0@lo:104: 00000100:00100000:2.0:1783951351.831837:0:22793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783951351.831933:0:22793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f9c40 expref: 23 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951351.831943:0:22793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9c47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f9c40 expref: 23 pid: 22771 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951351.831952:0:22793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22793:1870607945031168:0@lo:104: 00000100:00100000:2.0:1783951351.831974:0:22793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:1.0:1783951351.832201:0:25096:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1783951351.834457:0:25096:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1783951351.834467:0:25096:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1783951351.834524:0:25096:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783951351.834576:0:25096:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.133@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783951351.834597:0:25096:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1783951351.834626:0:25096:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1783951351.835601:0:25096:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783951351.836972:0:25096:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783951351.839859:0:22793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03484f0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951351.843134:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945031040 00000100:00100000:3.0:1783951351.843156:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945031040 00000100:00100000:3.0:1783951351.843224:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945031168 00000100:00100000:3.0:1783951351.843229:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945031168 00000100:00100000:3.0:1783951351.843247:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783951351.843256:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248608000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b1b2cfa-7097-4258-904b-0084ac551497+4:22793:x1870607945031040:12345-0@lo:104: 00010000:00010000:3.0:1783951351.843274:0:22760:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0247949400/0x7645c8e1169f9c4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9c55 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.843390:0:22760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783951351.843396:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248608000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b1b2cfa-7097-4258-904b-0084ac551497+4:22793:x1870607945031040:12345-0@lo:104: Request processed in 141us (11559us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951351.843403:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783951351.843421:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783951351.843428:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b1b2cfa-7097-4258-904b-0084ac551497+3:22793:x1870607945031168:12345-0@lo:104: 00010000:00010000:3.0:1783951351.843435:0:22760:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e0247949800/0x7645c8e1169f9c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9c47 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.843473:0:22760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783951351.843479:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b1b2cfa-7097-4258-904b-0084ac551497+3:22793:x1870607945031168:12345-0@lo:104: Request processed in 52us (11504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951351.843485:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1783951351.843507:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951351.843513:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247949400/0x7645c8e1169f9c4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9c55 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.843538:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783951351.843543:0:22766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247949400/0x7645c8e1169f9c4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f9c55 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.843551:0:22766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247949400/0x7645c8e1169f9c4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f9c55 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951351.843559:0:22766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247949400/0x7645c8e1169f9c4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f9c55 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951351.843565:0:22766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783951351.843598:0:22766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247949400/0x7645c8e1169f9c4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9c55 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.843604:0:22766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951351.843622:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247949400/0x7645c8e1169f9c4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9c55 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.843629:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247949400/0x7645c8e1169f9c4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9c55 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.843641:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951351.843644:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e0247949800/0x7645c8e1169f9c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9c47 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.843649:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1783951351.843652:0:22766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e0247949800/0x7645c8e1169f9c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f9c47 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.843668:0:22766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e0247949800/0x7645c8e1169f9c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f9c47 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951351.843675:0:22766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e0247949800/0x7645c8e1169f9c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f9c47 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951351.843680:0:22766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783951351.844811:0:22766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e0247949800/0x7645c8e1169f9c40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9c47 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.844821:0:22766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951351.844847:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e0247949800/0x7645c8e1169f9c40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9c47 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.844855:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e0247949800/0x7645c8e1169f9c40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9c47 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.844871:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951351.844873:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951351.844875:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951351.844885:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951351.844911:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b1b2cfa-7097-4258-904b-0084ac551497:3655:1870607945031296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951351.844965:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951351.845018:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b1b2cfa-7097-4258-904b-0084ac551497:3652:1870607945031424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951351.846847:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951351.846933:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945031296 00000100:00100000:3.0:1783951351.846940:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945031296 00010000:00010000:3.0:1783951351.846975:0:22762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9c55 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9c4e expref: 24 pid: 22769 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951351.847019:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945031424 00000100:00100000:2.0:1783951351.847152:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783951351.847163:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b1b2cfa-7097-4258-904b-0084ac551497+24:3655:x1870607945031296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783951351.847186:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951351.847193:0:22763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9c55 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9c4e expref: 24 pid: 22769 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951351.847205:0:22763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9c55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f9c4e expref: 24 pid: 22769 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951351.847226:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951351.847266:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b1b2cfa-7097-4258-904b-0084ac551497+24:3655:x1870607945031296:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951351.847275:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783951351.847327:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b1b2cfa-7097-4258-904b-0084ac551497:3655:1870607945031296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951351.847782:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945031424 00010000:00010000:3.0:1783951351.847803:0:22762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9c47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9c40 expref: 24 pid: 22771 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951351.847834:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783951351.847841:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b1b2cfa-7097-4258-904b-0084ac551497+24:3652:x1870607945031424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951351.847850:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951351.847854:0:22762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9c47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9c40 expref: 24 pid: 22771 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.847863:0:22762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9c47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f9c40 expref: 24 pid: 22771 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.847877:0:22762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e0247949200/0x7645c8e1169f9cd3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.847885:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247949200/0x7645c8e1169f9cd3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783951351.847900:0:22762:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016349800s 00010000:00010000:3.0:1783951351.847905:0:22762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0247949200/0x7645c8e1169f9cd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.847912:0:22762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0247949200/0x7645c8e1169f9cd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.847919:0:22762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e0247949200/0x7645c8e1169f9cd3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.847939:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e0247949200/0x7645c8e1169f9cd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.847946:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951351.847950:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e0247949200/0x7645c8e1169f9cd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.847957:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e0247949200/0x7645c8e1169f9cd3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.847967:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e0247949200/0x7645c8e1169f9cd3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951351.847978:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951351.848019:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b1b2cfa-7097-4258-904b-0084ac551497+24:3652:x1870607945031424:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951351.848136:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1783951351.848223:0:22793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b2600/0x7645c8e1169f9c55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f9c4e expref: 24 pid: 22769 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951351.848236:0:22793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22793:1870607945031040:0@lo:104: 00010000:00010000:2.0:1783951351.848248:0:22793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e03427e8800/0x7645c8e1169f9c47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f9c40 expref: 23 pid: 22771 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951351.848258:0:22793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22793:1870607945031168:0@lo:104: 00010000:00010000:2.0:1783951351.848274:0:22793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e0247949200/0x7645c8e1169f9cd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951351.848283:0:22793:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e0247949200/0x7645c8e1169f9cd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951351.848288:0:22793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e0247949200/0x7645c8e1169f9cd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951351.848294:0:22793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247949200/0x7645c8e1169f9cd3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951351.849201:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b1b2cfa-7097-4258-904b-0084ac551497:3652:1870607945031424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951352.352731:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951352.416505:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951352.416531:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945031552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951352.416608:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951352.416655:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945031680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951352.417525:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951352.417622:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945031552 00000100:00100000:3.0:1783951352.417631:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945031552 00000100:00100000:3.0:1783951352.417670:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945031680 00000100:00100000:3.0:1783951352.417673:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945031680 00000100:00100000:3.0:1783951352.417691:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783951352.417700:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945031552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783951352.417735:0:22783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783951352.417798:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945031552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951352.417822:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783951352.417841:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783951352.417846:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945031680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783951352.417864:0:22783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783951352.417909:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945031680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951352.417916:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783951352.418248:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945031680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951352.418350:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945031552:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1783951352.949394:0:25163:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783951352.949672:0:25163:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783951353.376536:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783951353.505793:0:23527:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1783951353.512402:0:22774:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783951353.512413:0:22774:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e0377b14000 from 14 10000000:01000000:2.0:1783951353.512418:0:22774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783951353.512494:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9cda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.512529:0:22774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9cda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.512542:0:22774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9cda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951353.512575:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945031808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783951353.512673:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951353.512722:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945031808 00000100:00100000:1.0:1783951353.512732:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945031808 00000100:00100000:2.0:1783951353.512738:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03484f0540 going to sleep for 11 seconds 00000100:00100000:1.0:1783951353.512803:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783951353.512816:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+22:22774:x1870607945031808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951353.512837:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951353.512857:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e03413c2000/0x7645c8e1169f9ce1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9cda expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.512892:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e03413c2000/0x7645c8e1169f9ce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9cda expref: 23 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.512905:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e03413c2000/0x7645c8e1169f9ce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9cda expref: 23 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.512920:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e03413c2000, rc 0) 00000100:00100000:1.0:1783951353.512976:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+23:22774:x1870607945031808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951353.512993:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783951353.513010:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945031808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951353.513026:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9cda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9ce1 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.513037:0:22774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9cda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9ce1 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951353.513096:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945031936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783951353.513123:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951353.513176:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03484f0540 going to sleep for 11 seconds 00000100:00100000:1.0:1783951353.513402:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945031936 00000100:00100000:1.0:1783951353.513414:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945031936 00000100:00100000:2.0:1783951353.513802:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783951353.513814:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+23:22774:x1870607945031936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783951353.513836:0:22772:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783951353.513861:0:22772:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783951353.513866:0:22772:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1783951353.513990:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+23:22774:x1870607945031936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 178us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951353.514013:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783951353.514013:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945031936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783951353.514086:0:22774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783951353.514094:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9cda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9ce1 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.514103:0:22774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0247949200/0x7645c8e1169f9cda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9ce1 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951353.514118:0:22774:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783951353.514120:0:22774:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e037ca6d800 from 14 10000000:01000000:1.0:1783951353.514122:0:22774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783951353.514365:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9ce8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.514372:0:22774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9ce8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.514379:0:22774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9ce8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951353.514395:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945032064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951353.514440:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951353.514475:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945032064 00000100:00100000:1.0:1783951353.514476:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246b6a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951353.514481:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945032064 00000100:00100000:2.0:1783951353.514519:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783951353.514528:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+23:22774:x1870607945032064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951353.514537:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951353.514551:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9cef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9ce8 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.514573:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9ce8 expref: 24 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.514583:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247949800/0x7645c8e1169f9cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9ce8 expref: 24 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.514592:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247949800, rc 0) 00000100:00100000:2.0:1783951353.514627:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+24:22774:x1870607945032064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951353.514633:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783951353.514689:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945032064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951353.514703:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9ce8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9cef expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.514716:0:22774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9ce8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9cef expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951353.514765:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945032192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783951353.514798:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951353.514816:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246b6a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951353.514830:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945032192 00000100:00100000:2.0:1783951353.514834:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945032192 00000100:00100000:2.0:1783951353.514863:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783951353.514871:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+24:22774:x1870607945032192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783951353.514884:0:22771:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783951353.514898:0:22771:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783951353.514901:0:22771:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1783951353.514984:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+24:22774:x1870607945032192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951353.514999:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945032192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783951353.515000:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 10000000:01000000:1.0:1783951353.515046:0:22774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783951353.515052:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9ce8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9cef expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.515057:0:22774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e03413c3e00/0x7645c8e1169f9ce8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9cef expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951353.824449:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951333/real 1783951333] req@ffff9e037fc64700 x1870607945019136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951353 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951353.824487:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e037fc64700 x1870607945019136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951353 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951353.824498:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951333/real 1783951333] req@ffff9e037fc66300 x1870607945019264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951353 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951353.824526:0:3651:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e037fc66300 x1870607945019264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783951353 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783951353.824545:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e037e6db800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951353.824574:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783951353.824578:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945019136:0@lo:8:kworker.0 00000100:00080000:0.0:1783951353.824585:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e035079f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951353.824590:0:3651:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783951353.824593:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945019264:0@lo:8:kworker.0 00000100:00080000:1.0:1783951353.824696:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951353.824701:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783951353.824704:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e037e6db800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951353.824709:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 689 00000100:00080000:1.0:1783951353.824714:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783951353.824721:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e037e6db800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951353.824742:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0377abfb80 x1870607945032448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951353.824754:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951353.824756:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783951353.824764:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e035079f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951353.824767:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 689 00000100:00080000:1.0:1783951353.824770:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783951353.824774:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e035079f800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951353.824784:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0377abc000 x1870607945032576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951353.824820:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783951353.824823:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783951353.824825:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e0246426800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951353.824828:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 707 00000100:00080000:1.0:1783951353.824831:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783951353.824835:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e0246426800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1783951353.824845:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0377abd180 x1870607945033088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951353.824897:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945032960:0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.824967:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951353.824997:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607945033600:0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.825025:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951353.825044:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783951353.825050:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945032320:0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.825075:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951353.825095:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607945033216:0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.825115:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951353.825131:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607945033728:0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.825210:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951353.825234:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945032832:0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.825256:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951353.825281:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607945033472:0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.825302:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951353.825315:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783951353.825320:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607945032704:0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.825340:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951353.825350:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607945033344:0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.825366:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951353.825394:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945032960 00000100:00100000:1.0:1783951353.825401:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945032960 00000100:00100000:1.0:1783951353.825460:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783951353.825470:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945032960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.825517:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945032960:12345-0@lo:400:kworker.0 Request processed in 49us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951353.825524:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783951353.825546:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945032320 00000100:00100000:1.0:1783951353.825549:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945032320 00000100:00100000:1.0:1783951353.825564:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945032832 00000100:00100000:1.0:1783951353.825567:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945032832 00000100:00100000:1.0:1783951353.825579:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783951353.825585:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945032320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.825614:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945032320:12345-0@lo:400:kworker.0 Request processed in 30us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951353.825620:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783951353.825637:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783951353.825643:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945032832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.825670:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945032832:12345-0@lo:400:kworker.0 Request processed in 28us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951353.825676:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783951353.825690:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945033600 00000100:00100000:1.0:1783951353.825693:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945033600 00000100:00100000:1.0:1783951353.825710:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945033216 00000100:00100000:1.0:1783951353.825712:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945033216 00000100:00100000:1.0:1783951353.825721:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945033728 00000100:00100000:1.0:1783951353.825723:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945033728 00000100:00100000:1.0:1783951353.825734:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945033472 00000100:00100000:1.0:1783951353.825736:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945033472 00000100:00100000:1.0:1783951353.825745:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945032704 00000100:00100000:1.0:1783951353.825747:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945032704 00000100:00100000:1.0:1783951353.825757:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945033344 00000100:00100000:1.0:1783951353.825759:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945033344 00000100:00100000:1.0:1783951353.825770:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783951353.825775:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607945033600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.825801:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607945033600:12345-0@lo:400:kworker.0 Request processed in 25us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951353.825807:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783951353.825817:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783951353.825823:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607945033216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.825845:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1870607945033216:12345-0@lo:400:kworker.0 Request processed in 22us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951353.825850:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783951353.825861:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783951353.825867:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037d247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607945033728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.825913:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037d247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1870607945033728:12345-0@lo:400:kworker.0 Request processed in 46us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951353.825919:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783951353.825931:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783951353.825937:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607945033472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.825963:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1870607945033472:12345-0@lo:400:kworker.0 Request processed in 26us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951353.825968:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783951353.825981:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783951353.825987:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607945032704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.826011:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607945032704:12345-0@lo:400:kworker.0 Request processed in 24us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951353.826017:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783951353.826028:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783951353.826033:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607945033344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.826057:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607945033344:12345-0@lo:400:kworker.0 Request processed in 24us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951353.826063:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1783951353.826083:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951353.826087:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783951353.826089:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783951353.826116:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abe680 x1870607945032704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951353.826128:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607945032704:0@lo:400:kworker.0 00010000:00080000:1.0:1783951353.826138:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abea00 x1870607945033344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951353.826188:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607945033344:0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.826201:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945032832:0@lo:400:kworker.0 00010000:00080000:1.0:1783951353.826210:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abd880 x1870607945033472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951353.826217:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3653:1870607945033472:0@lo:400:kworker.0 00000100:00100000:1.0:1783951353.826247:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945032320:0@lo:400:kworker.0 00010000:00080000:1.0:1783951353.826257:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abf480 x1870607945033216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951353.826264:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3654:1870607945033216:0@lo:400:kworker.0 00010000:00080000:1.0:1783951353.826273:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abce00 x1870607945033728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951353.826281:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3654:1870607945033728:0@lo:400:kworker.0 00010000:00080000:1.0:1783951353.826290:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abe300 x1870607945032960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783951369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951353.826297:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945032960:0@lo:400:kworker.0 00010000:00080000:1.0:1783951353.826306:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abf800 x1870607945033600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951353.826313:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607945033600:0@lo:400:kworker.0 00000100:00100000:0.0:1783951353.826835:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945032448:0@lo:8:kworker.0 00000100:00100000:0.0:1783951353.826875:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951353.826932:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945032576:0@lo:8:kworker.0 00000100:00100000:0.0:1783951353.826965:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951353.826986:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945033088:0@lo:8:kworker.0 00000100:00100000:0.0:1783951353.827009:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951353.827039:0:24810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945032448 00000100:00100000:0.0:1783951353.827044:0:24810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945032448 00000100:00100000:0.0:1783951353.827065:0:24810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945032576 00000100:00100000:0.0:1783951353.827068:0:24810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945032576 00000100:00100000:0.0:1783951353.827075:0:24810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945033088 00000100:00100000:0.0:1783951353.827077:0:24810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945033088 00000100:00100000:0.0:1783951353.827085:0:24810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783951353.827090:0:24810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3651:x1870607945032448:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783951353.827117:0:24810:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 709 last 0 00000020:00000080:0.0:1783951353.827179:0:24810:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f9cf6 00002000:00100000:0.0:1783951353.827203:0:24810:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e0245b15000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1783951353.827207:0:24810:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1783951353.827211:0:24810:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783951353.827440:0:24810:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783951353.827465:0:24810:0:(import.c:65:import_set_state_nolock()) ffff9e0245b10000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951353.827510:0:24810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1870607945032448:12345-0@lo:8:kworker.0 Request processed in 419us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951353.827517:0:24810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783951353.827532:0:24810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783951353.827536:0:24810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3651:x1870607945032576:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783951353.827551:0:24810:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 709 last 0 00000020:00000080:0.0:1783951353.827567:0:24810:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7645c8e1169f9cfd 00002000:00100000:0.0:1783951353.827573:0:24810:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e0245b15800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783951353.827576:0:24810:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783951353.827578:0:24810:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783951353.827716:0:24810:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783951353.827730:0:24810:0:(import.c:65:import_set_state_nolock()) ffff9e0245b11800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951353.827759:0:24810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1870607945032576:12345-0@lo:8:kworker.0 Request processed in 221us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951353.827766:0:24810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783951353.827779:0:24810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783951353.827783:0:24810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3651:x1870607945033088:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783951353.827798:0:24810:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 709 last 0 00000020:00000080:0.0:1783951353.827814:0:24810:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7645c8e1169f9d04 00002000:00100000:0.0:1783951353.827820:0:24810:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9e0245b12800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1783951353.827831:0:24810:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1783951353.827833:0:24810:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783951353.827859:0:24810:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1783951353.827872:0:24810:0:(import.c:65:import_set_state_nolock()) ffff9e0245b14800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951353.827902:0:24810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1870607945033088:12345-0@lo:8:kworker.0 Request processed in 116us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951353.827908:0:24810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1783951353.827949:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abfb80 x1870607945032448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783951378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951353.827970:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783951353.827978:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1783951353.827986:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783951353.827991:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783951353.827993:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e037e6db800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783951353.828018:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783951353.828023:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945032448:0@lo:8:kworker.0 00010000:00080000:0.0:1783951353.828038:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abc000 x1870607945032576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783951378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951353.828045:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783951353.828049:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1783951353.828053:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783951353.828056:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783951353.828058:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e035079f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783951353.828077:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783951353.828081:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3651:1870607945032576:0@lo:8:kworker.0 00010000:00080000:0.0:1783951353.828094:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abd180 x1870607945033088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783951378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951353.828107:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783951353.828112:0:3651:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1783951353.828117:0:3651:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783951353.828120:0:3651:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783951353.828121:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9e0246426800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783951353.828134:0:3651:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783951353.828138:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3651:1870607945033088:0@lo:8:kworker.0 00000004:00080000:0.0:1783951353.828197:0:22801:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783951353.828267:0:22801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709476124076ns, next at 0ns, rc = 0 00000004:00080000:2.0:1783951353.828498:0:22802:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1783951353.828515:0:22802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22802:1870607945033984:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783951353.828546:0:22802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951353.828563:0:22802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03484f0e40 going to sleep for 11 seconds 00000004:00080000:2.0:1783951353.828574:0:22803:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783951353.828616:0:22803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709476473601ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783951353.828623:0:22803:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00080000:00080000:0.0:1783951353.830232:0:22801:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1783951353.830422:0:23520:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1783951353.830458:0:23520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23520:1870607945034240:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1783951353.830508:0:23520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951353.830534:0:23520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342e2fc00 going to sleep for 11 seconds 00000004:00080000:0.0:1783951353.830548:0:23519:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783951353.830614:0:23519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 709478471569ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783951353.830619:0:23519:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1783951353.831413:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945033984 00000100:00100000:1.0:1783951353.831421:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945033984 00000100:00100000:1.0:1783951353.831478:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945034240 00000100:00100000:1.0:1783951353.831481:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945034240 00000100:00100000:1.0:1783951353.831498:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783951353.831505:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22802:x1870607945033984:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1783951353.833130:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951353.833136:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951353.833181:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945034112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951353.833244:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951353.833447:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951353.833454:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607945033856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951353.833477:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951353.833507:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945034112 00000100:00100000:1.0:1783951353.833528:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945034112 00000100:00100000:1.0:1783951353.833559:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945033856 00000100:00100000:1.0:1783951353.833562:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945033856 00000100:00100000:1.0:1783951353.833575:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951353.833581:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3653:x1870607945034112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783951353.833607:0:24284:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1783951353.833646:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3653:x1870607945034112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951353.833653:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951353.833668:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783951353.833674:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02483a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1870607945033856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951353.833687:0:24284:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783951353.833706:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02483a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1870607945033856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951353.833711:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783951353.833747:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0248608700 x1870607945033856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951353.833766:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607945033856:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1783951353.833775:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037e426a00 x1870607945034112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951353.833786:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945034112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951353.834880:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951353.834893:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23520:x1870607945034240:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1783951353.837266:0:22804:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1783951353.837435:0:22804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22804:1870607945034496:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783951353.837504:0:22804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951353.837542:0:22804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037cb1bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951353.837597:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951353.837609:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607945034368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951353.837632:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951353.837667:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945034368 00000100:00100000:3.0:1783951353.837674:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945034368 00000100:00100000:3.0:1783951353.837723:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783951353.837731:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607945034368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951353.837751:0:24284:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1783951353.837799:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607945034368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951353.837806:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1783951353.837848:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fc64a80 x1870607945034368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783951369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951353.837878:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607945034368:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783951353.837900:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1783951353.838440:0:24281:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1783951353.838448:0:24281:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:1.0:1783951353.838454:0:24281:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00000100:00100000:0.0:1783951353.839512:0:24282:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1783951353.839524:0:24282:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000004:00080000:0.0:1783951353.840454:0:22757:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1783951353.840470:0:22757:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1783951353.840519:0:23509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1783951353.840561:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945034496 00000100:00100000:0.0:1783951353.840570:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945034496 00000100:00100000:0.0:1783951353.840693:0:25206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783951353.840710:0:25206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:22804:x1870607945034496:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1783951353.852271:0:25206:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1783951353.852282:0:25206:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1783951353.852289:0:25206:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00010000:1.0:1783951353.853526:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.853537:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061c6d05b/0x7645c8e1169f9d0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.853557:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.853562:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.853569:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061c6d05b/0x7645c8e1169f9d0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.853587:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061c6d05b/0x7645c8e1169f9d0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.853598:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061c6d05b/0x7645c8e1169f9d0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.853607:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061c6d05b/0x7645c8e1169f9d0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.853639:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951353.853777:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.853783:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061c6d05b/0x7645c8e1169f9d0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.853792:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.853796:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061c6d05b/0x7645c8e1169f9d0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.853806:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061c6d05b/0x7645c8e1169f9d0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.853823:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061c6d05b/0x7645c8e1169f9d0b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.853831:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061c6d05b/0x7645c8e1169f9d0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.853848:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.853850:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.853852:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951353.854104:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.854110:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9d12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854119:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.854127:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.854133:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9d12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854192:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9d12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854202:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9d12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854208:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9d12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854223:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951353.854314:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.854320:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9d12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854328:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.854331:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9d12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854340:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9d12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854351:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9d12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854369:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9d12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854384:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.854386:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.854388:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951353.854568:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.854574:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9d19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854582:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.854585:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.854589:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9d19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854599:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9d19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854607:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9d19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854613:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9d19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854626:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951353.854713:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.854723:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9d19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854731:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.854735:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9d19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854742:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9d19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854753:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9d19 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854760:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9d19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.854773:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.854774:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.854776:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1783951353.857177:0:24283:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1783951353.859011:0:24283:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1783951353.859118:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23520:x1870607945034240:12345-0@lo:7:osp-pre-1-1.0 Request processed in 24224us (28605us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951353.859129:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00002000:00010000:1.0:1783951353.859485:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.859495:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.859512:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.859517:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.859524:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.859553:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.859564:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.859572:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.859590:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951353.859778:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.859785:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.859793:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.859797:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.859806:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.859823:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.859831:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.859855:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.859857:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.859859:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951353.860427:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.860435:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0fc4584/0x7645c8e1169f9d27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.860447:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.860450:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.860455:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0fc4584/0x7645c8e1169f9d27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.860463:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0fc4584/0x7645c8e1169f9d27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.860471:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0fc4584/0x7645c8e1169f9d27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.860478:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0fc4584/0x7645c8e1169f9d27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.860502:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951353.861526:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.861535:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9d2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.861561:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.861565:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.861570:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9d2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.861580:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9d2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.861588:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9d2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.861595:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9d2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.861611:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783951353.861856:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951353.861864:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0fc4584/0x7645c8e1169f9d27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.861873:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66e00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951353.861877:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0fc4584/0x7645c8e1169f9d27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.861885:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0fc4584/0x7645c8e1169f9d27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.861904:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0fc4584/0x7645c8e1169f9d27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.861912:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0fc4584/0x7645c8e1169f9d27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.861930:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951353.861934:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9d2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.861946:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66600 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951353.861949:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9d2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.861957:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9d2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.862101:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9d2e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.862108:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d538c09e/0x7645c8e1169f9d2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.862121:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951353.862123:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951353.862125:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1783951353.862652:0:23520:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037e427480 x1870607945034240/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783951369 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951353.862668:0:23520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23520:1870607945034240:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1783951353.862680:0:23520:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1783951353.862720:0:23520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23520:1870607945034624:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1783951353.862772:0:23520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951353.862800:0:23520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342e2fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951353.862821:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945034624 00000100:00100000:0.0:1783951353.862826:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945034624 00000100:00100000:0.0:1783951353.862866:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783951353.862874:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23520:x1870607945034624:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1783951353.862898:0:24282:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1783951353.862930:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23520:x1870607945034624:12345-0@lo:5:osp-pre-1-1.0 Request processed in 57us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951353.862937:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00002000:00010000:1.0:1783951353.863129:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.863136:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019d1a4cc/0x7645c8e1169f9d35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.863186:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.863190:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.863195:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019d1a4cc/0x7645c8e1169f9d35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.863205:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019d1a4cc/0x7645c8e1169f9d35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.863226:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019d1a4cc/0x7645c8e1169f9d35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.863233:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019d1a4cc/0x7645c8e1169f9d35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.863245:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951353.864107:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951353.864116:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019d1a4cc/0x7645c8e1169f9d35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.864126:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67e00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951353.864132:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019d1a4cc/0x7645c8e1169f9d35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.864154:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019d1a4cc/0x7645c8e1169f9d35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.864193:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019d1a4cc/0x7645c8e1169f9d35 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.864202:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019d1a4cc/0x7645c8e1169f9d35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.864221:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951353.864223:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951353.864224:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951353.864626:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.864632:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c5201eb/0x7645c8e1169f9d3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.864644:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.864648:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.864653:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5201eb/0x7645c8e1169f9d3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.864665:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5201eb/0x7645c8e1169f9d3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.864673:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c5201eb/0x7645c8e1169f9d3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.864680:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c5201eb/0x7645c8e1169f9d3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.864719:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1783951353.865121:0:23520:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037e427480 x1870607945034624/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783951369 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951353.865136:0:23520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23520:1870607945034624:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1783951353.865176:0:23520:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1783951353.865214:0:23520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23520:1870607945034752:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1783951353.865258:0:23520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951353.865278:0:23520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342e2fc00 going to sleep for 11 seconds 00010000:00010000:3.0:1783951353.865348:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951353.865363:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c5201eb/0x7645c8e1169f9d3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.865373:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67a00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951353.865377:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5201eb/0x7645c8e1169f9d3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.865386:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5201eb/0x7645c8e1169f9d3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.865401:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c5201eb/0x7645c8e1169f9d3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.865408:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5201eb/0x7645c8e1169f9d3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.865438:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951353.865440:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951353.865442:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951353.865456:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945034752 00000100:00100000:3.0:1783951353.865462:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945034752 00000100:00100000:3.0:1783951353.865509:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783951353.865518:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23520:x1870607945034752:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1783951353.865561:0:24283:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:1.0:1783951353.866793:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.866803:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003139e321/0x7645c8e1169f9d43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.866818:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.866823:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.866829:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003139e321/0x7645c8e1169f9d43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.866841:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003139e321/0x7645c8e1169f9d43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.866852:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003139e321/0x7645c8e1169f9d43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.866860:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003139e321/0x7645c8e1169f9d43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.866881:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951353.869629:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.869642:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a24eee3/0x7645c8e1169f9d4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.869659:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.869671:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.869678:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a24eee3/0x7645c8e1169f9d4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.869693:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a24eee3/0x7645c8e1169f9d4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.869704:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a24eee3/0x7645c8e1169f9d4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.869712:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a24eee3/0x7645c8e1169f9d4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.869726:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783951353.872358:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783951353.872376:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003139e321/0x7645c8e1169f9d43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.872391:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:0.0:1783951353.872396:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003139e321/0x7645c8e1169f9d43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.872407:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003139e321/0x7645c8e1169f9d43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.872429:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003139e321/0x7645c8e1169f9d43 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.872436:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003139e321/0x7645c8e1169f9d43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.872458:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951353.872462:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a24eee3/0x7645c8e1169f9d4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.872469:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:0.0:1783951353.872472:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a24eee3/0x7645c8e1169f9d4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.872480:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a24eee3/0x7645c8e1169f9d4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.872502:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a24eee3/0x7645c8e1169f9d4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.872509:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a24eee3/0x7645c8e1169f9d4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.872523:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951353.872525:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951353.872527:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951353.873263:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.873272:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9d51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.873284:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.873289:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.873295:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9d51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.873308:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9d51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.873318:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9d51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.873332:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9d51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.873419:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951353.873786:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951353.873792:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9d51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.873801:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:0.0:1783951353.873805:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9d51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.873814:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9d51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.873828:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9d51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.873836:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9d51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.873865:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951353.873866:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951353.873868:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951353.873945:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.873950:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c003cc9/0x7645c8e1169f9d58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.874424:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.874428:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.874433:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c003cc9/0x7645c8e1169f9d58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.874444:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c003cc9/0x7645c8e1169f9d58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.874453:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c003cc9/0x7645c8e1169f9d58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.874462:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c003cc9/0x7645c8e1169f9d58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.874478:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951353.874571:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.874577:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c003cc9/0x7645c8e1169f9d58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.874589:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.874593:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c003cc9/0x7645c8e1169f9d58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.874602:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c003cc9/0x7645c8e1169f9d58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.874613:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c003cc9/0x7645c8e1169f9d58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.874620:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c003cc9/0x7645c8e1169f9d58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.874635:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.874636:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.874638:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951353.874703:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951353.880690:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.880702:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9d5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.880720:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.880725:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.880731:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9d5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.880747:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9d5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.880758:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9d5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.880766:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9d5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.880796:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951353.881188:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.881196:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9d5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.881205:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247949400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.881210:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9d5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.881219:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9d5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.881242:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9d5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.881249:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae2d0d97/0x7645c8e1169f9d5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.881264:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.881266:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.881268:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951353.881599:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.881607:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ba07dc2/0x7645c8e1169f9d66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.881617:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.881620:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.881625:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ba07dc2/0x7645c8e1169f9d66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.881638:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ba07dc2/0x7645c8e1169f9d66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.881646:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ba07dc2/0x7645c8e1169f9d66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.881654:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ba07dc2/0x7645c8e1169f9d66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.881681:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951353.881918:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.881924:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ba07dc2/0x7645c8e1169f9d66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.881932:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e8800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.881936:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ba07dc2/0x7645c8e1169f9d66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.881944:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ba07dc2/0x7645c8e1169f9d66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.881967:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ba07dc2/0x7645c8e1169f9d66 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.881975:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ba07dc2/0x7645c8e1169f9d66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.882011:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.882013:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.882015:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951353.882199:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.882205:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9d6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.882214:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.882217:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.882221:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9d6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.882229:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9d6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.882236:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9d6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.882242:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9d6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.882256:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783951353.882672:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.882678:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc93d066/0x7645c8e1169f9d74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.882686:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.882689:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.882693:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc93d066/0x7645c8e1169f9d74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.882701:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc93d066/0x7645c8e1169f9d74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.882709:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc93d066/0x7645c8e1169f9d74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.882716:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc93d066/0x7645c8e1169f9d74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.882727:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951353.883279:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951353.883286:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9d6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.883295:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340031c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.883298:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9d6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.883306:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9d6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.883320:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9d6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.883327:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9d6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.883344:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.883348:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc93d066/0x7645c8e1169f9d74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.883360:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e9a00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.883370:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc93d066/0x7645c8e1169f9d74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.883378:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc93d066/0x7645c8e1169f9d74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.883388:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc93d066/0x7645c8e1169f9d74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.883396:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc93d066/0x7645c8e1169f9d74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.883411:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.883412:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.883413:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.883419:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951353.883520:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.883525:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9d7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.883534:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.883544:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.883549:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9d7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.883559:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9d7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.883566:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9d7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.883573:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9d7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.883595:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783951353.883803:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.883809:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b158356/0x7645c8e1169f9d82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.883816:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.883824:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.883829:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b158356/0x7645c8e1169f9d82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.883837:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b158356/0x7645c8e1169f9d82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.883845:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b158356/0x7645c8e1169f9d82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.883850:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b158356/0x7645c8e1169f9d82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.883861:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951353.884237:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951353.884242:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9d7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.884249:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030a00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.884253:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9d7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.884259:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9d7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.884270:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9d7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.884283:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9d7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.884298:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.884302:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b158356/0x7645c8e1169f9d82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.884308:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03413c2800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.884312:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b158356/0x7645c8e1169f9d82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.884319:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b158356/0x7645c8e1169f9d82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.884328:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b158356/0x7645c8e1169f9d82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.884335:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b158356/0x7645c8e1169f9d82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.884348:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.884350:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.884351:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.884357:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951353.884685:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.884692:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bd1c5a9/0x7645c8e1169f9d89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.884701:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.884704:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.884709:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bd1c5a9/0x7645c8e1169f9d89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.884719:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bd1c5a9/0x7645c8e1169f9d89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.884727:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bd1c5a9/0x7645c8e1169f9d89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.884740:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bd1c5a9/0x7645c8e1169f9d89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.884759:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783951353.887504:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.887516:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f9d90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.887532:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.887537:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.887543:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f9d90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.887555:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f9d90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.887564:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f9d90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.887577:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f9d90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.887593:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951353.888291:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951353.888300:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bd1c5a9/0x7645c8e1169f9d89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.888318:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.888322:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bd1c5a9/0x7645c8e1169f9d89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.888331:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bd1c5a9/0x7645c8e1169f9d89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.888350:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bd1c5a9/0x7645c8e1169f9d89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.888358:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bd1c5a9/0x7645c8e1169f9d89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.888379:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.888383:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f9d90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.888389:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.888393:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f9d90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.888401:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f9d90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.888411:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f9d90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.888425:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011684372/0x7645c8e1169f9d90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.888439:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.888440:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.888442:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.888448:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951353.888742:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.888749:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c003cc9/0x7645c8e1169f9d97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.888759:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.888763:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.888768:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c003cc9/0x7645c8e1169f9d97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.888777:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c003cc9/0x7645c8e1169f9d97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.888786:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c003cc9/0x7645c8e1169f9d97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.888794:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c003cc9/0x7645c8e1169f9d97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.888813:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951353.889176:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951353.889182:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c003cc9/0x7645c8e1169f9d97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.889191:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951353.889195:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c003cc9/0x7645c8e1169f9d97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.889203:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c003cc9/0x7645c8e1169f9d97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.889215:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c003cc9/0x7645c8e1169f9d97 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.889223:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c003cc9/0x7645c8e1169f9d97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.889238:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951353.889239:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951353.889241:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951353.890218:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.890229:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.890242:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.890247:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.890252:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.890264:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.890273:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.890281:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.890297:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951353.890472:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.890479:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.890488:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.890492:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.890512:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.890526:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.890533:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3870d4b/0x7645c8e1169f9d9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.890548:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.890549:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.890550:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951353.890771:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.890777:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9da5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.890786:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.890789:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.890794:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9da5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.890803:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9da5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.890811:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9da5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.890825:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9da5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.890837:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951353.891135:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951353.891170:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9da5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.891177:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951353.891180:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9da5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.891188:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9da5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.891201:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9da5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.891207:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f54174f9/0x7645c8e1169f9da5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.891224:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951353.891225:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951353.891227:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951353.891277:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.891282:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f9dac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.891291:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.891294:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.891298:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f9dac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.891319:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f9dac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.891327:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f9dac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.891335:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f9dac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.891351:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951353.891639:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.891645:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9db3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.891653:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.891656:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.891659:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9db3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.891667:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9db3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.891674:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9db3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.891680:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9db3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.891700:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951353.891785:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951353.891791:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f9dac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.891803:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.891807:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f9dac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.891813:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f9dac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.891825:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f9dac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.891832:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b4e6ee1/0x7645c8e1169f9dac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.891846:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.891850:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9db3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.891855:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.891858:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9db3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.891863:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9db3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.891871:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9db3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.891883:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052d3ead0/0x7645c8e1169f9db3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.891897:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.891899:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.891900:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951353.892207:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951353.892900:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.892906:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9dba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.892915:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.892917:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.892920:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9dba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.892927:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9dba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.892932:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9dba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.892937:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9dba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.892949:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951353.892967:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.892977:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9dba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.892984:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.892988:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9dba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.892996:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9dba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.893016:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9dba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.893021:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9dba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.893032:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.893033:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.893034:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951353.893506:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1783951353.893510:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.893513:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb29a74/0x7645c8e1169f9dc1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.893515:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9dc8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.893523:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.893523:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.893527:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.893527:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.893532:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb29a74/0x7645c8e1169f9dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.893532:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9dc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.893542:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cb29a74/0x7645c8e1169f9dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.893551:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb29a74/0x7645c8e1169f9dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.893552:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9dc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.893560:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9dc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.893569:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9dc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.893570:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cb29a74/0x7645c8e1169f9dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.893624:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951353.893894:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.893899:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec781971/0x7645c8e1169f9dcf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.893907:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.893910:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.894095:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec781971/0x7645c8e1169f9dcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.894110:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec781971/0x7645c8e1169f9dcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.894119:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec781971/0x7645c8e1169f9dcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.894138:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec781971/0x7645c8e1169f9dcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.894258:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783951353.894258:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783951353.894264:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9dc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.894271:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.894274:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9dc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.894282:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9dc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.894299:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9dc8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.894306:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b081dc3c/0x7645c8e1169f9dc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.894322:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783951353.894326:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cb29a74/0x7645c8e1169f9dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.894341:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.894345:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb29a74/0x7645c8e1169f9dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.894352:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb29a74/0x7645c8e1169f9dc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.894363:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cb29a74/0x7645c8e1169f9dc1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.894370:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cb29a74/0x7645c8e1169f9dc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.894383:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951353.894386:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec781971/0x7645c8e1169f9dcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.894393:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67600 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.894395:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec781971/0x7645c8e1169f9dcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.894403:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec781971/0x7645c8e1169f9dcf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.894412:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec781971/0x7645c8e1169f9dcf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.894426:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.894428:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.894430:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951353.894842:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.894849:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000155eee60/0x7645c8e1169f9dd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.894857:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.894861:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.894866:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000155eee60/0x7645c8e1169f9dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.894875:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000155eee60/0x7645c8e1169f9dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.894883:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000155eee60/0x7645c8e1169f9dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.894891:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000155eee60/0x7645c8e1169f9dd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.894904:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951353.895015:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951353.895020:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000155eee60/0x7645c8e1169f9dd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895037:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030600 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.895041:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000155eee60/0x7645c8e1169f9dd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895048:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000155eee60/0x7645c8e1169f9dd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895060:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000155eee60/0x7645c8e1169f9dd6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895067:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000155eee60/0x7645c8e1169f9dd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895081:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.895083:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.895084:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951353.895338:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.895344:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f40bddfd/0x7645c8e1169f9ddd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895353:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.895355:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.895360:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f40bddfd/0x7645c8e1169f9ddd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895369:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f40bddfd/0x7645c8e1169f9ddd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895384:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f40bddfd/0x7645c8e1169f9ddd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895390:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f40bddfd/0x7645c8e1169f9ddd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895402:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951353.895489:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951353.895494:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f40bddfd/0x7645c8e1169f9ddd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895501:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030e00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.895504:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f40bddfd/0x7645c8e1169f9ddd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895512:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f40bddfd/0x7645c8e1169f9ddd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895521:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f40bddfd/0x7645c8e1169f9ddd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895528:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f40bddfd/0x7645c8e1169f9ddd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895540:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.895546:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.895548:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951353.895736:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.895742:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7adfe62/0x7645c8e1169f9de4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895749:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.895751:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.895755:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7adfe62/0x7645c8e1169f9de4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895763:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7adfe62/0x7645c8e1169f9de4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895770:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7adfe62/0x7645c8e1169f9de4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895777:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7adfe62/0x7645c8e1169f9de4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895789:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951353.895872:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951353.895877:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7adfe62/0x7645c8e1169f9de4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895885:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.895888:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7adfe62/0x7645c8e1169f9de4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895906:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7adfe62/0x7645c8e1169f9de4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895917:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7adfe62/0x7645c8e1169f9de4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895924:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7adfe62/0x7645c8e1169f9de4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.895937:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.895938:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.895940:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951353.896136:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.896157:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060a11d2d/0x7645c8e1169f9deb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.896175:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.896178:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.896182:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060a11d2d/0x7645c8e1169f9deb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.896191:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060a11d2d/0x7645c8e1169f9deb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.896199:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060a11d2d/0x7645c8e1169f9deb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.896213:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060a11d2d/0x7645c8e1169f9deb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.896225:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951353.896314:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951353.896319:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060a11d2d/0x7645c8e1169f9deb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.896326:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.896329:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060a11d2d/0x7645c8e1169f9deb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.896337:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060a11d2d/0x7645c8e1169f9deb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.896348:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060a11d2d/0x7645c8e1169f9deb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.896355:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060a11d2d/0x7645c8e1169f9deb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.896368:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.896369:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.896371:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.899441:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783951353.899456:0:25206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec781971/0x7645c8e1169f9dcf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.899470:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.899492:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951353.899816:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.899822:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f9df2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.899832:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.899836:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.899840:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f9df2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.899849:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f9df2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.899855:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f9df2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.899860:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f9df2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.899882:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951353.899901:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951353.899907:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f9df2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.899916:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66a00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951353.899921:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f9df2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.899930:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f9df2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.900065:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f9df2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.900074:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007402693b/0x7645c8e1169f9df2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.900110:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951353.900112:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951353.900113:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951353.900201:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.900207:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7c80317/0x7645c8e1169f9df9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.900215:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.900218:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.900222:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7c80317/0x7645c8e1169f9df9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.900231:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7c80317/0x7645c8e1169f9df9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.900239:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7c80317/0x7645c8e1169f9df9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.900246:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7c80317/0x7645c8e1169f9df9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.900267:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783951353.900476:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.900482:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cea3d796/0x7645c8e1169f9e00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.900489:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.900492:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.900495:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cea3d796/0x7645c8e1169f9e00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.900513:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cea3d796/0x7645c8e1169f9e00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.900520:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cea3d796/0x7645c8e1169f9e00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.900526:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cea3d796/0x7645c8e1169f9e00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.900541:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783951353.900548:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783951353.900553:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7c80317/0x7645c8e1169f9df9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.900561:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:0.0:1783951353.900564:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7c80317/0x7645c8e1169f9df9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.900572:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7c80317/0x7645c8e1169f9df9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.900585:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7c80317/0x7645c8e1169f9df9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.900592:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7c80317/0x7645c8e1169f9df9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.900607:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951353.900611:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cea3d796/0x7645c8e1169f9e00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.900617:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:0.0:1783951353.900626:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cea3d796/0x7645c8e1169f9e00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.900634:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cea3d796/0x7645c8e1169f9e00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.900645:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cea3d796/0x7645c8e1169f9e00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.900653:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cea3d796/0x7645c8e1169f9e00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951353.900664:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951353.900665:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951353.900667:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.900799:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951353.900803:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.900809:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc3754b3/0x7645c8e1169f9e07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.900817:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.900820:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.900824:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc3754b3/0x7645c8e1169f9e07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.900833:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc3754b3/0x7645c8e1169f9e07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.900841:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc3754b3/0x7645c8e1169f9e07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.900858:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc3754b3/0x7645c8e1169f9e07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.900879:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951353.901019:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.901023:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc3754b3/0x7645c8e1169f9e07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.901031:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609600 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.901034:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc3754b3/0x7645c8e1169f9e07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.901043:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc3754b3/0x7645c8e1169f9e07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.901054:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc3754b3/0x7645c8e1169f9e07 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.901061:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc3754b3/0x7645c8e1169f9e07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.901075:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.901077:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.901078:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951353.901251:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.901256:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038ed09f6/0x7645c8e1169f9e0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.901265:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.901268:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.901272:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038ed09f6/0x7645c8e1169f9e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.901280:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038ed09f6/0x7645c8e1169f9e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.901287:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038ed09f6/0x7645c8e1169f9e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.901293:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038ed09f6/0x7645c8e1169f9e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.901314:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951353.901462:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.901468:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038ed09f6/0x7645c8e1169f9e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.901486:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609400 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.901489:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038ed09f6/0x7645c8e1169f9e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.901498:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038ed09f6/0x7645c8e1169f9e0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.901509:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038ed09f6/0x7645c8e1169f9e0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.901516:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038ed09f6/0x7645c8e1169f9e0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.901528:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.901530:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.901532:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951353.901666:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.901672:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9e15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.901684:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.901686:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.901690:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9e15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.901698:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9e15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.901706:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9e15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.901713:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9e15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.901732:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783951353.902192:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.902198:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9e1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.902208:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.902211:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.902215:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9e1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.902224:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9e1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.902244:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9e1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.902252:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9e1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.902265:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951353.902909:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951353.902915:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9e15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.902924:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.902928:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9e15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.902937:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9e15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.902959:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9e15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.902966:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9e15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.902982:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.902986:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9e1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.902992:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.902995:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9e1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.903003:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9e1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.903014:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9e1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.903020:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9e1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.903031:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.903032:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.903039:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.903046:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951353.903568:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.903584:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd0619c/0x7645c8e1169f9e23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.903595:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.903600:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.903606:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fd0619c/0x7645c8e1169f9e23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.903618:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fd0619c/0x7645c8e1169f9e23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.903627:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd0619c/0x7645c8e1169f9e23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.903636:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fd0619c/0x7645c8e1169f9e23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.903656:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783951353.904274:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.904281:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f874dfb6/0x7645c8e1169f9e2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904290:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.904293:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.904298:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f874dfb6/0x7645c8e1169f9e2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904307:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f874dfb6/0x7645c8e1169f9e2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904321:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f874dfb6/0x7645c8e1169f9e2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904327:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f874dfb6/0x7645c8e1169f9e2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904342:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783951353.904425:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783951353.904430:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fd0619c/0x7645c8e1169f9e23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904437:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340031800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.904441:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd0619c/0x7645c8e1169f9e23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904450:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd0619c/0x7645c8e1169f9e23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904463:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fd0619c/0x7645c8e1169f9e23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904470:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fd0619c/0x7645c8e1169f9e23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904484:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951353.904494:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f874dfb6/0x7645c8e1169f9e2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904500:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340031600 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.904503:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f874dfb6/0x7645c8e1169f9e2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904511:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f874dfb6/0x7645c8e1169f9e2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904522:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f874dfb6/0x7645c8e1169f9e2a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904528:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f874dfb6/0x7645c8e1169f9e2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904539:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.904541:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.904542:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951353.904800:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.904806:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9e31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904814:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.904817:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.904821:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9e31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904841:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9e31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904849:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9e31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904857:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9e31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904869:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951353.904950:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951353.904955:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9e31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904962:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340030a00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.904965:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9e31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904972:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9e31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904982:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9e31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.904989:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bac82027/0x7645c8e1169f9e31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.905015:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.905017:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.905019:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783951353.905407:0:25097:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1783951353.905433:0:25097:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1783951353.905445:0:25097:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1783951353.905490:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.905497:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9e38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.905505:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.905508:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.905513:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9e38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.905522:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9e38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.905530:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9e38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.905538:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9e38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.905551:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951353.905855:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.905862:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9e38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.905870:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0340031c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.905874:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9e38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.905882:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9e38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.905895:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9e38 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.905903:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097664742/0x7645c8e1169f9e38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.905919:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.905921:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.905923:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951353.905958:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.905963:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9e3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.905972:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.905975:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.905987:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9e3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.905997:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9e3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.906015:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9e3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.906024:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9e3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.906037:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951353.906045:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.906048:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9e3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.906055:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.906059:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9e3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.906067:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9e3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.906077:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9e3f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.906094:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051fcbcf8/0x7645c8e1169f9e3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.906110:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.906111:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.906113:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951353.906350:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.906360:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080891fde/0x7645c8e1169f9e46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.906368:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.906371:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.906375:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080891fde/0x7645c8e1169f9e46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.906383:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080891fde/0x7645c8e1169f9e46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.906391:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080891fde/0x7645c8e1169f9e46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.906398:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080891fde/0x7645c8e1169f9e46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.906418:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951353.906502:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951353.906507:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080891fde/0x7645c8e1169f9e46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.906515:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e036b4a8200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.906518:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080891fde/0x7645c8e1169f9e46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.906526:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080891fde/0x7645c8e1169f9e46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.906542:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080891fde/0x7645c8e1169f9e46 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.906549:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080891fde/0x7645c8e1169f9e46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.906563:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.906565:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.906566:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951353.906833:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.906839:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000709d17b8/0x7645c8e1169f9e4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.906847:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.906851:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.906854:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000709d17b8/0x7645c8e1169f9e4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.906863:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000709d17b8/0x7645c8e1169f9e4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.906870:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000709d17b8/0x7645c8e1169f9e4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.906877:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000709d17b8/0x7645c8e1169f9e4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.906901:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951353.906988:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951353.906993:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000709d17b8/0x7645c8e1169f9e4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.906999:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e036b4a9200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.907009:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000709d17b8/0x7645c8e1169f9e4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.907017:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000709d17b8/0x7645c8e1169f9e4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.907029:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000709d17b8/0x7645c8e1169f9e4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.907035:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000709d17b8/0x7645c8e1169f9e4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.907048:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.907050:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.907052:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.907280:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951353.907370:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.907376:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2670a84/0x7645c8e1169f9e54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.907384:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.907393:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.907397:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2670a84/0x7645c8e1169f9e54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.907406:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2670a84/0x7645c8e1169f9e54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.907415:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2670a84/0x7645c8e1169f9e54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.907422:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2670a84/0x7645c8e1169f9e54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.907434:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951353.907524:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951353.907529:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2670a84/0x7645c8e1169f9e54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.907536:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e036b4a9000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.907540:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2670a84/0x7645c8e1169f9e54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.907547:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2670a84/0x7645c8e1169f9e54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.907557:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2670a84/0x7645c8e1169f9e54 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.907574:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2670a84/0x7645c8e1169f9e54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.907586:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.907588:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.907590:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951353.907630:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.907636:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bc5a91a/0x7645c8e1169f9e5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.907643:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.907646:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.907650:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bc5a91a/0x7645c8e1169f9e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.907659:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bc5a91a/0x7645c8e1169f9e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.907666:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bc5a91a/0x7645c8e1169f9e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.907673:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bc5a91a/0x7645c8e1169f9e5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.907685:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951353.907968:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.907974:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bc5a91a/0x7645c8e1169f9e5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.907981:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e036b4a8800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.907984:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bc5a91a/0x7645c8e1169f9e5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.907991:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bc5a91a/0x7645c8e1169f9e5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.908003:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bc5a91a/0x7645c8e1169f9e5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.908017:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bc5a91a/0x7645c8e1169f9e5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.908032:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.908034:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.908040:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783951353.908529:0:24281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.908541:0:24281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab8461cb/0x7645c8e1169f9e62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.908550:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.908553:0:24281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.908558:0:24281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab8461cb/0x7645c8e1169f9e62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.908567:0:24281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab8461cb/0x7645c8e1169f9e62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.908575:0:24281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab8461cb/0x7645c8e1169f9e62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.908583:0:24281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab8461cb/0x7645c8e1169f9e62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.908598:0:24281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951353.908607:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951353.908612:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab8461cb/0x7645c8e1169f9e62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.908619:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e036b4a9c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951353.908622:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab8461cb/0x7645c8e1169f9e62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.908630:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab8461cb/0x7645c8e1169f9e62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.908641:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab8461cb/0x7645c8e1169f9e62 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.908648:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab8461cb/0x7645c8e1169f9e62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.908663:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951353.908670:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951353.908671:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1783951353.908791:0:24281:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1783951353.908871:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22802:x1870607945033984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 77362us (80319us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951353.908881:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783951353.908901:0:22802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22802:1870607945033984:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783951353.908915:0:22802:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00002000:00010000:2.0:1783951353.908977:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.908982:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a37b21a8/0x7645c8e1169f9e69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.908991:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.908999:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.909003:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a37b21a8/0x7645c8e1169f9e69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.909027:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a37b21a8/0x7645c8e1169f9e69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.909035:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a37b21a8/0x7645c8e1169f9e69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.909042:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a37b21a8/0x7645c8e1169f9e69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.909054:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783951353.909088:0:22802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22802:1870607945034880:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783951353.909123:0:22802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951353.909266:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.909271:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a37b21a8/0x7645c8e1169f9e69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.909279:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e036b4a9800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.909282:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a37b21a8/0x7645c8e1169f9e69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.909289:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a37b21a8/0x7645c8e1169f9e69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951353.909300:0:22802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0351335600 going to sleep for 11 seconds 00010000:00010000:1.0:1783951353.909300:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a37b21a8/0x7645c8e1169f9e69 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.909307:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a37b21a8/0x7645c8e1169f9e69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951353.909316:0:24810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945034880 00010000:00010000:1.0:1783951353.909320:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.909321:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951353.909322:0:24810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945034880 00010000:00010000:1.0:1783951353.909323:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951353.909433:0:24810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783951353.909442:0:24810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22802:x1870607945034880:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1783951353.909482:0:24810:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00002000:00010000:1.0:1783951353.914901:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951353.914916:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9e70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.914934:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=709s v=(0 0) 00010000:00010000:1.0:1783951353.914938:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951353.914945:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9e70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.914968:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9e70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.914978:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9e70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.914986:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9e70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.915011:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951353.915036:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951353.915043:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9e70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.915051:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951353.915056:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9e70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.915064:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9e70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.915080:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9e70 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.915097:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061c6d05b/0x7645c8e1169f9e70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.915116:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951353.915118:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951353.915119:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951353.919580:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23520:x1870607945034752:12345-0@lo:5:osp-pre-1-1.0 Request processed in 54055us (54312us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1783951353.919593:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783951353.919597:0:23520:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1783951353.919605:0:23520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23520:1870607945034752:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1783951353.919620:0:23520:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1783951353.919668:0:23520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23520:1870607945035008:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1783951353.919697:0:23520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951353.919724:0:23520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342e2fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951353.919740:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945035008 00000100:00100000:3.0:1783951353.919746:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945035008 00000100:00100000:3.0:1783951353.919789:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783951353.919798:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23520:x1870607945035008:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1783951353.919843:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23520:x1870607945035008:12345-0@lo:900:osp-pre-1-1.0 Request processed in 46us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951353.919849:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:2.0:1783951353.920031:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.920039:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b50ebb6/0x7645c8e1169f9e77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.920056:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.920061:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.920067:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b50ebb6/0x7645c8e1169f9e77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.920080:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b50ebb6/0x7645c8e1169f9e77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.920090:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b50ebb6/0x7645c8e1169f9e77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.920107:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b50ebb6/0x7645c8e1169f9e77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.920125:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951353.920137:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951353.920344:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b50ebb6/0x7645c8e1169f9e77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.920351:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e036b4a8a00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.920355:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b50ebb6/0x7645c8e1169f9e77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.920364:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b50ebb6/0x7645c8e1169f9e77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.920381:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b50ebb6/0x7645c8e1169f9e77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.920388:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b50ebb6/0x7645c8e1169f9e77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.920403:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.920405:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.920406:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1783951353.920808:0:23520:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037e427480 x1870607945035008/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783951369 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951353.920821:0:23520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23520:1870607945035008:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1783951353.921572:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951353.921590:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edc6cba5/0x7645c8e1169f9e7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.921604:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=709s v=(0 0) 00010000:00010000:2.0:1783951353.921607:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951353.921613:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edc6cba5/0x7645c8e1169f9e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.921620:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edc6cba5/0x7645c8e1169f9e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.921626:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edc6cba5/0x7645c8e1169f9e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.921631:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edc6cba5/0x7645c8e1169f9e7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.921646:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951353.921664:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951353.921670:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edc6cba5/0x7645c8e1169f9e7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.921677:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e036b4a8600 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951353.921680:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edc6cba5/0x7645c8e1169f9e7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.921688:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edc6cba5/0x7645c8e1169f9e7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.921707:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edc6cba5/0x7645c8e1169f9e7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.921714:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edc6cba5/0x7645c8e1169f9e7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.921728:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951353.921729:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951353.921731:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783951353.921872:0:24277:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1783951353.921913:0:24277:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1783951353.922306:0:24810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22802:x1870607945034880:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12862us (13179us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1783951353.922317:0:24810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783951353.922624:0:22802:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1783951353.922632:0:22802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22802:1870607945034880:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783951353.922646:0:22802:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00002000:00010000:3.0:1783951353.922649:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.922655:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff1b32c4/0x7645c8e1169f9e85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.922665:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.922668:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.922673:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff1b32c4/0x7645c8e1169f9e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.922684:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff1b32c4/0x7645c8e1169f9e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.922693:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff1b32c4/0x7645c8e1169f9e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.922714:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff1b32c4/0x7645c8e1169f9e85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.922734:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951353.924216:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951353.924227:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff1b32c4/0x7645c8e1169f9e85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.924238:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609a00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.924249:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff1b32c4/0x7645c8e1169f9e85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.924268:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff1b32c4/0x7645c8e1169f9e85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.924288:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff1b32c4/0x7645c8e1169f9e85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.924296:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff1b32c4/0x7645c8e1169f9e85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.924312:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.924313:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.924315:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951353.924366:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.924373:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ef4eccb/0x7645c8e1169f9e8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.924383:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.924387:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.924393:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ef4eccb/0x7645c8e1169f9e8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.924403:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ef4eccb/0x7645c8e1169f9e8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.924411:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ef4eccb/0x7645c8e1169f9e8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.924419:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ef4eccb/0x7645c8e1169f9e8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.924438:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951353.924594:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951353.924601:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ef4eccb/0x7645c8e1169f9e8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.924609:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608e00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951353.924613:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ef4eccb/0x7645c8e1169f9e8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.924621:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ef4eccb/0x7645c8e1169f9e8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.924632:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ef4eccb/0x7645c8e1169f9e8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.924638:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ef4eccb/0x7645c8e1169f9e8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951353.924657:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.924659:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951353.924661:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951353.924947:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.925010:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e45d53e/0x7645c8e1169f9e93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.925024:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.925027:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.925032:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e45d53e/0x7645c8e1169f9e93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.925042:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e45d53e/0x7645c8e1169f9e93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.925051:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e45d53e/0x7645c8e1169f9e93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.925058:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e45d53e/0x7645c8e1169f9e93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.925077:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951353.925248:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951353.925254:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e45d53e/0x7645c8e1169f9e93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.925271:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.925275:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e45d53e/0x7645c8e1169f9e93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.925283:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e45d53e/0x7645c8e1169f9e93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.925294:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e45d53e/0x7645c8e1169f9e93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.925308:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e45d53e/0x7645c8e1169f9e93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.925321:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.925323:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.925324:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951353.925401:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.925407:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0c4713b/0x7645c8e1169f9e9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.925415:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.925418:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.925422:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0c4713b/0x7645c8e1169f9e9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.925431:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0c4713b/0x7645c8e1169f9e9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.925450:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0c4713b/0x7645c8e1169f9e9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.925458:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0c4713b/0x7645c8e1169f9e9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.925477:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783951353.926437:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.926444:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7812710/0x7645c8e1169f9ea1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.926456:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.926459:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.926464:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7812710/0x7645c8e1169f9ea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.926473:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7812710/0x7645c8e1169f9ea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.926482:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7812710/0x7645c8e1169f9ea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.926490:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7812710/0x7645c8e1169f9ea1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.926512:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783951353.926785:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.926791:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003990eaee/0x7645c8e1169f9ea8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.926799:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.926802:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.926807:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003990eaee/0x7645c8e1169f9ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.926815:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003990eaee/0x7645c8e1169f9ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.926822:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003990eaee/0x7645c8e1169f9ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.926828:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003990eaee/0x7645c8e1169f9ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.926837:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1783951353.927213:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.927219:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f9eaf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.927228:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.927237:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.927241:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f9eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.927254:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f9eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.927263:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f9eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.927269:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f9eaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.927277:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1783951353.927566:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.927572:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9eb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.927580:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.927582:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.927586:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9eb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.927595:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9eb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.927601:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9eb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.927613:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9eb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.927620:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1783951353.927845:0:25206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951353.927850:0:25206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9ebd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.927858:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=709s v=(0 0) 00010000:00010000:3.0:1783951353.927860:0:25206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951353.927864:0:25206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9ebd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.927872:0:25206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9ebd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.927879:0:25206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9ebd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.927885:0:25206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9ebd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951353.927892:0:25206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00080000:3.0:1783951353.927921:0:25206:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1783951353.928234:0:25206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:22804:x1870607945034496:12345-0@lo:5:osp-pre-1-0.0 Request processed in 87522us (90726us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951353.928250:0:25206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783951353.928316:0:22804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22804:1870607945034496:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783951353.928330:0:22804:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1783951353.928448:0:22804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22804:1870607945035136:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783951353.928484:0:22804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951353.928508:0:22804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e03432ddd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783951353.928527:0:25206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945035136 00000100:00100000:3.0:1783951353.928532:0:25206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945035136 00000100:00100000:3.0:1783951353.928575:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783951353.928583:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22804:x1870607945035136:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783951353.928625:0:24282:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:2.0:1783951353.930309:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783951353.930320:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0c4713b/0x7645c8e1169f9e9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930334:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609e00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.930340:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0c4713b/0x7645c8e1169f9e9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930351:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0c4713b/0x7645c8e1169f9e9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930372:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0c4713b/0x7645c8e1169f9e9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930379:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0c4713b/0x7645c8e1169f9e9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930400:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783951353.930404:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7812710/0x7645c8e1169f9ea1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930417:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608a00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.930421:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7812710/0x7645c8e1169f9ea1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930429:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7812710/0x7645c8e1169f9ea1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930440:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7812710/0x7645c8e1169f9ea1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930447:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7812710/0x7645c8e1169f9ea1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930460:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783951353.930464:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003990eaee/0x7645c8e1169f9ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930472:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.930475:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003990eaee/0x7645c8e1169f9ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930483:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003990eaee/0x7645c8e1169f9ea8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930493:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003990eaee/0x7645c8e1169f9ea8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930505:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003990eaee/0x7645c8e1169f9ea8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930518:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783951353.930523:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f9eaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930529:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608600 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.930533:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f9eaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930540:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f9eaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930551:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f9eaf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930558:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec0a4b97/0x7645c8e1169f9eaf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930570:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783951353.930574:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9eb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930581:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.930590:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9eb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930599:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9eb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930611:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9eb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930618:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094200ef5/0x7645c8e1169f9eb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930632:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951353.930636:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9ebd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930643:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343609c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951353.930647:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9ebd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930655:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9ebd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930665:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9ebd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930673:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1d73755/0x7645c8e1169f9ebd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951353.930692:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.930694:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.930695:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951353.930708:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951353.933834:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22804:x1870607945035136:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5240us (5338us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1783951353.933847:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783951353.933956:0:22804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22804:1870607945035136:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783951353.933972:0:22804:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:2.0:1783951354.402766:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951355.433505:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951356.462052:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951356.518836:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945035264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951356.518915:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951356.519054:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945035264 00000100:00100000:1.0:1783951356.519063:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945035264 00000100:00100000:1.0:1783951356.519133:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783951356.519176:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607945035264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783951356.519211:0:24284:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783951356.519258:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607945035264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951356.519265:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1783951356.519473:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951356.519516:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945035264:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783951357.472269:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951357.536843:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783951357.536867:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0341219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945035392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951357.536943:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951357.537008:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945035392 00000100:00100000:0.0:1783951357.537015:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945035392 00000100:00100000:0.0:1783951357.537071:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783951357.537081:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945035392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783951357.537119:0:22783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783951357.537193:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945035392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951357.537202:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783951357.537250:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0341219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945035392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951357.541254:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951357.541277:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0341219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945035520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951357.541351:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951357.541416:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945035520 00000100:00100000:0.0:1783951357.541423:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945035520 00000100:00100000:0.0:1783951357.541464:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783951357.541472:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607945035520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783951357.541508:0:22783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783951357.541551:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607945035520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951357.541559:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783951357.541602:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0341219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945035520:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783951358.503918:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783951358.526668:0:25453:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1783951359.075991:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0341219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945035648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951359.076062:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951359.076090:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945035648 00000100:00100000:1.0:1783951359.076098:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945035648 00000100:00100000:3.0:1783951359.076272:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945035904:0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.076300:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951359.076329:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945036416:0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.076362:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951359.076381:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0349482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607945036928:0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.076407:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951359.076430:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945037440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951359.076451:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951359.076481:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783951359.076487:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945036032:0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.076507:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951359.076523:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0349480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945036544:0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.076540:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951359.076553:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0349482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607945037056:0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.076572:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951359.076600:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945035904 00000100:00100000:3.0:1783951359.076604:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945035904 00000100:00100000:3.0:1783951359.076634:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945036416 00000100:00100000:3.0:1783951359.076637:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945036416 00000100:00100000:3.0:1783951359.076651:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783951359.076657:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607945035904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.076709:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607945035904:12345-0@lo:400:kworker.0 Request processed in 51us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951359.076717:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783951359.076734:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783951359.076740:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945036416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951359.076740:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945037440 00000100:00100000:2.0:1783951359.076743:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945037440 00000100:00100000:3.0:1783951359.076769:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945036416:12345-0@lo:400:kworker.0 Request processed in 29us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951359.076775:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783951359.076799:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945036032 00000100:00100000:3.0:1783951359.076803:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945036032 00000100:00100000:1.0:1783951359.076816:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783951359.076822:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945036544 00000100:00100000:1.0:1783951359.076823:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945035648:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951359.076824:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945036544 00002000:00000024:1.0:1783951359.077162:0:24284:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1783951359.077202:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945035648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 380us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951359.077208:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783951359.077228:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945036928 00000100:00100000:1.0:1783951359.077231:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945036928 00000100:00100000:2.0:1783951359.078554:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783951359.078565:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1870607945037440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783951359.078608:0:24285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783951359.078660:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1870607945037440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951359.078666:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783951359.078708:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783951359.078717:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607945036032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951359.078752:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607945036032:12345-0@lo:400:kworker.0 Request processed in 36us (2243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951359.078758:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783951359.079000:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783951359.079006:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945036544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.079054:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945036544:12345-0@lo:400:kworker.0 Request processed in 48us (2513us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951359.079059:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783951359.079084:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945037056 00000100:00100000:3.0:1783951359.079090:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945037056 00000100:00100000:3.0:1783951359.079266:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783951359.079273:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607945037056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.079318:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1870607945037056:12345-0@lo:400:kworker.0 Request processed in 46us (2744us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951359.079324:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783951359.079352:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b1b2cfa-7097-4258-904b-0084ac551497:3655:1870607945035776:0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.079390:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951359.079423:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607945036288:0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.079446:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951359.079462:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0349482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607945036800:0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.079503:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951359.079524:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0248609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607945037312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951359.079545:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951359.079567:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783951359.079574:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607945036160:0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.079605:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951359.079624:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0349480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607945036672:0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.079644:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951359.079658:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0349483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607945037184:0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.079690:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951359.079718:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945035776 00000100:00100000:3.0:1783951359.079722:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945035776 00000100:00100000:3.0:1783951359.079748:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783951359.079754:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+24:3655:x1870607945035776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.079792:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+24:3655:x1870607945035776:12345-0@lo:400:kworker.0 Request processed in 38us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951359.079798:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783951359.079826:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945036160 00000100:00100000:3.0:1783951359.079829:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945036160 00000100:00100000:3.0:1783951359.079854:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783951359.079860:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607945036160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.079893:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1870607945036160:12345-0@lo:400:kworker.0 Request processed in 33us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951359.079899:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783951359.079914:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945036288 00000100:00100000:3.0:1783951359.079917:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945036288 00000100:00100000:3.0:1783951359.079931:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945036800 00000100:00100000:3.0:1783951359.079933:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945036800 00000100:00100000:3.0:1783951359.079946:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945036672 00000100:00100000:3.0:1783951359.079948:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945036672 00000100:00100000:3.0:1783951359.079966:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945037184 00000100:00100000:3.0:1783951359.079968:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945037184 00000100:00100000:3.0:1783951359.079983:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783951359.079995:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607945036288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.080029:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1870607945036288:12345-0@lo:400:kworker.0 Request processed in 34us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951359.080035:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783951359.080047:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783951359.080053:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607945036800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.080083:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1870607945036800:12345-0@lo:400:kworker.0 Request processed in 30us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951359.080089:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783951359.080101:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783951359.080107:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607945036672:12345-0@lo:400:kworker.0 00000001:00080000:2.0:1783951359.080239:0:25097:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:3.0:1783951359.080525:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1870607945036672:12345-0@lo:400:kworker.0 Request processed in 418us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951359.080531:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783951359.080543:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783951359.080549:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036ae28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607945037184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.080577:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036ae28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1870607945037184:12345-0@lo:400:kworker.0 Request processed in 29us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951359.080583:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783951359.080636:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0341219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945035648:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783951359.080639:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951359.080662:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945037312 00000100:00100000:3.0:1783951359.080666:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945037312 00000100:00100000:3.0:1783951359.080692:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783951359.080698:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607945037312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951359.080711:0:24285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1783951359.080751:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607945037312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951359.080757:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783951359.080790:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945036032:0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.080803:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0349480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945036544:0@lo:400:kworker.0 00010000:00080000:3.0:1783951359.080819:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0349482a00 x1870607945037056/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951359.080830:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0349482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3652:1870607945037056:0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.080846:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945037440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951359.080858:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945035904:0@lo:400:kworker.0 00000100:00100000:1.0:1783951359.081348:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783951359.081357:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607945036928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951359.081398:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1870607945036928:12345-0@lo:400:kworker.0 Request processed in 43us (4990us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951359.081413:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783951359.082826:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945036416:0@lo:400:kworker.0 00010000:00080000:3.0:1783951359.082845:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0349482680 x1870607945036928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951359.082855:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0349482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3652:1870607945036928:0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.082988:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607945036160:0@lo:400:kworker.0 00010000:00080000:3.0:1783951359.083002:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0349480a80 x1870607945036672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951359.083011:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0349480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3655:1870607945036672:0@lo:400:kworker.0 00010000:00080000:3.0:1783951359.083024:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0349483800 x1870607945037184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951359.083032:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0349483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3655:1870607945037184:0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.083054:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b1b2cfa-7097-4258-904b-0084ac551497:3655:1870607945035776:0@lo:400:kworker.0 00010000:00080000:3.0:1783951359.083066:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fc64000 x1870607945036288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951359.083074:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3655:1870607945036288:0@lo:400:kworker.0 00010000:00080000:3.0:1783951359.083085:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0349482d80 x1870607945036800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951359.083092:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0349482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3655:1870607945036800:0@lo:400:kworker.0 00000100:00100000:3.0:1783951359.083101:0:3655:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1783951359.083366:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0248609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607945037312:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783951359.084005:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783951359.084012:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951359.084014:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000004:0.0:1783951359.415468:0:25507:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783951359.415715:0:25507:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783951359.532238:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783951360.335961:0:25557:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783951360.336404:0:25557:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783951360.556012:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951360.651916:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951360.652322:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923953920 00000100:00100000:2.0:1783951360.652336:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923953920 00000100:00100000:2.0:1783951360.652399:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 113 00000100:00100000:2.0:1783951360.652410:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2406:x1870607923953920:12345-192.168.202.33@tcp:250:mount.lustre.0 00010000:00080000:2.0:1783951360.652447:0:22769:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 705f0753-e3a3-473c-9c20-46e2ee691cf8@192.168.202.33@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:2.0:1783951360.652485:0:22769:0:(genops.c:1406:class_connect()) connect: client 705f0753-e3a3-473c-9c20-46e2ee691cf8, cookie 0x7645c8e1169f9ec4 00000100:00080000:2.0:1783951360.653328:0:22769:0:(import.c:65:import_set_state_nolock()) ffff9e0247764000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951360.653431:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+5:2406:x1870607923953920:12345-192.168.202.33@tcp:250:mount.lustre.0 Request processed in 1019us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951360.653444:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 113 00000100:00100000:0.0:1783951360.666512:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951360.666792:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923954048 00000100:00100000:1.0:1783951360.666806:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923954048 00000100:00100000:1.0:1783951360.666886:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 114 00000100:00100000:1.0:1783951360.666899:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+5:18102:x1870607923954048:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783951360.666923:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951360.666948:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a67c00/0x7645c8e1169f9ecb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fb12 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951360.666986:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a67c00/0x7645c8e1169f9ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb12 expref: 6 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951360.666999:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a67c00/0x7645c8e1169f9ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb12 expref: 6 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951360.667010:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67c00, rc 0) 00000100:00100000:1.0:1783951360.667088:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+6:18102:x1870607923954048:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 191us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951360.667107:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 114 00000100:00100000:0.0:1783951360.676604:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951360.680853:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923954176 00000100:00100000:2.0:1783951360.680872:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923954176 00000100:00100000:2.0:1783951360.680989:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 115 00000100:00100000:2.0:1783951360.681003:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+6:18102:x1870607923954176:12345-192.168.202.33@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783951360.681238:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+6:18102:x1870607923954176:12345-192.168.202.33@tcp:501:mount.lustre.0 Request processed in 237us (4649us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783951360.681248:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 115 00000100:00100000:0.0:1783951360.685304:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951360.685463:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923954304 00000100:00100000:3.0:1783951360.685475:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923954304 00000100:00100000:3.0:1783951360.685541:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 116 00000100:00100000:3.0:1783951360.685552:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+6:18102:x1870607923954304:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783951360.685573:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951360.685596:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0343609600/0x7645c8e1169f9ed2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fb19 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951360.685633:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0343609600/0x7645c8e1169f9ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb19 expref: 7 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951360.685646:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0343609600/0x7645c8e1169f9ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb19 expref: 7 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951360.685667:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609600, rc 0) 00000100:00100000:3.0:1783951360.685742:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+7:18102:x1870607923954304:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 192us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951360.685768:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 116 00000100:00100000:0.0:1783951360.693389:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951360.693562:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923954432 00000100:00100000:3.0:1783951360.693575:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923954432 00000100:00100000:3.0:1783951360.693774:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 117 00000100:00100000:3.0:1783951360.693790:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+7:18102:x1870607923954432:12345-192.168.202.33@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783951360.694018:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+8:18102:x1870607923954432:12345-192.168.202.33@tcp:501:mount.lustre.0 Request processed in 233us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951360.694026:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 117 00000100:00100000:0.0:1783951360.700786:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951360.702550:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923954560 00000100:00100000:2.0:1783951360.702570:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923954560 00000100:00100000:2.0:1783951360.704581:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 118 00000100:00100000:2.0:1783951360.704617:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+8:18102:x1870607923954560:12345-192.168.202.33@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783951360.704857:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+8:18102:x1870607923954560:12345-192.168.202.33@tcp:503:mount.lustre.0 Request processed in 260us (4084us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951360.704867:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 118 00000100:00100000:0.0:1783951360.725435:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951360.725919:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923954688 00000100:00100000:3.0:1783951360.725934:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923954688 00000100:00100000:3.0:1783951360.726016:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 119 00000100:00100000:3.0:1783951360.726028:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+8:18121:x1870607923954688:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783951360.726283:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+8:18121:x1870607923954688:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 257us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951360.726292:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 119 00000100:00100000:0.0:1783951360.770227:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951360.770438:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923954816 00000100:00100000:2.0:1783951360.770469:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923954816 00000100:00100000:2.0:1783951360.770544:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 120 00000100:00100000:2.0:1783951360.770556:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+8:18121:x1870607923954816:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783951360.770762:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+8:18121:x1870607923954816:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 207us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951360.770771:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 120 00000100:00100000:0.0:1783951360.775217:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951360.775314:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923954944 00000100:00100000:1.0:1783951360.775326:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923954944 00000100:00100000:1.0:1783951360.775396:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 121 00000100:00100000:1.0:1783951360.775408:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+8:18121:x1870607923954944:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783951360.775609:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+8:18121:x1870607923954944:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 202us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951360.775628:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 121 00000100:00100000:0.0:1783951360.782137:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951360.782389:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923955072 00000100:00100000:3.0:1783951360.782402:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923955072 00000100:00100000:3.0:1783951360.782475:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 122 00000100:00100000:3.0:1783951360.782487:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+8:18102:x1870607923955072:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783951360.782511:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951360.782535:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0343609400/0x7645c8e1169f9ed9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fb4a expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951360.782575:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0343609400/0x7645c8e1169f9ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb4a expref: 9 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951360.782607:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0343609400/0x7645c8e1169f9ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb4a expref: 9 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951360.782618:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609400, rc 0) 00000100:00100000:3.0:1783951360.782697:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+9:18102:x1870607923955072:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 211us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951360.782705:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 122 00000100:00100000:0.0:1783951360.794028:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951360.798607:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923955200 00000100:00100000:2.0:1783951360.798631:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923955200 00000100:00100000:2.0:1783951360.798734:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 123 00000100:00100000:2.0:1783951360.798748:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+9:18102:x1870607923955200:12345-192.168.202.33@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783951360.798783:0:22769:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783951360.798816:0:22769:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783951360.798821:0:22769:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783951360.798824:0:22769:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783951360.798826:0:22769:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1783951360.798829:0:22769:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1783951360.802525:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+9:18102:x1870607923955200:12345-192.168.202.33@tcp:256:mount.lustre.0 Request processed in 3763us (8497us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951360.802544:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 123 00000100:00100000:0.0:1783951360.806743:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951360.809659:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923955328 00000100:00100000:1.0:1783951360.809682:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923955328 00000100:00100000:1.0:1783951360.809788:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 124 00000100:00100000:1.0:1783951360.809801:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+9:18102:x1870607923955328:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783951360.809826:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951360.809854:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a66000/0x7645c8e1169f9ee0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fb51 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951360.809896:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a66000/0x7645c8e1169f9ee0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb51 expref: 10 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951360.809910:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a66000/0x7645c8e1169f9ee0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb51 expref: 10 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951360.809920:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66000, rc 0) 00000100:00100000:1.0:1783951360.814847:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+10:18102:x1870607923955328:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 5028us (8099us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951360.814864:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 124 00000100:00100000:0.0:1783951360.822089:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951360.829137:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923955456 00000100:00100000:2.0:1783951360.829179:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923955456 00000100:00100000:2.0:1783951360.829278:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 125 00000100:00100000:2.0:1783951360.829298:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+10:18102:x1870607923955456:12345-192.168.202.33@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783951360.829547:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+10:18102:x1870607923955456:12345-192.168.202.33@tcp:501:mount.lustre.0 Request processed in 251us (7474us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951360.829557:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 125 00000100:00100000:0.0:1783951360.837254:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951360.837329:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923955584 00000100:00100000:1.0:1783951360.837348:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923955584 00000100:00100000:1.0:1783951360.837437:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 126 00000100:00100000:1.0:1783951360.837451:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+10:18102:x1870607923955584:12345-192.168.202.33@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783951360.837683:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+10:18102:x1870607923955584:12345-192.168.202.33@tcp:503:mount.lustre.0 Request processed in 234us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951360.837692:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 126 00000100:00100000:0.0:1783951360.843347:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951360.843457:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923955712 00000100:00100000:3.0:1783951360.843469:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923955712 00000100:00100000:3.0:1783951360.843533:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 127 00000100:00100000:3.0:1783951360.843615:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+10:18125:x1870607923955712:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783951360.843783:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+10:18125:x1870607923955712:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 240us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951360.843791:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 127 00000100:00100000:0.0:1783951360.855456:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951360.855567:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923955840 00000100:00100000:2.0:1783951360.855585:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923955840 00000100:00100000:2.0:1783951360.855673:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 128 00000100:00100000:2.0:1783951360.855685:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ca4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+10:18125:x1870607923955840:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783951360.858069:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ca4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+10:18125:x1870607923955840:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 2368us (2606us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951360.858091:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 128 00000100:00100000:0.0:1783951360.866664:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951360.866785:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951360.867170:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923955968 00000100:00100000:3.0:1783951360.867182:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923955968 00000100:00100000:3.0:1783951360.867232:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923956224 00000100:00100000:3.0:1783951360.867235:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923956224 00000100:00100000:3.0:1783951360.867251:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:3.0:1783951360.867260:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1870607923955968:12345-192.168.202.33@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783951360.867292:0:22777:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from a3b69357-ecfd-411d-bcaf-eec1ed5aa77c@192.168.202.33@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:3.0:1783951360.867390:0:22777:0:(genops.c:1406:class_connect()) connect: client a3b69357-ecfd-411d-bcaf-eec1ed5aa77c, cookie 0x7645c8e1169f9ee7 00000004:00100000:3.0:1783951360.867422:0:22777:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783951360.867672:0:22777:0:(import.c:65:import_set_state_nolock()) ffff9e024859a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951360.868187:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:2406:x1870607923955968:12345-192.168.202.33@tcp:38:mount.lustre.0 Request processed in 923us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951360.868210:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:3.0:1783951360.868231:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:3.0:1783951360.868236:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1870607923956224:12345-192.168.202.33@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783951360.868257:0:22777:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from a3b69357-ecfd-411d-bcaf-eec1ed5aa77c@192.168.202.33@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:3.0:1783951360.868296:0:22777:0:(genops.c:1406:class_connect()) connect: client a3b69357-ecfd-411d-bcaf-eec1ed5aa77c, cookie 0x7645c8e1169f9eee 00000004:00100000:3.0:1783951360.868313:0:22777:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783951360.868446:0:22777:0:(import.c:65:import_set_state_nolock()) ffff9e024859d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951360.869453:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:2406:x1870607923956224:12345-192.168.202.33@tcp:38:mount.lustre.0 Request processed in 240us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951360.869465:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:1.0:1783951360.889661:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951360.889777:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951360.889959:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951360.890025:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923956352 00000100:00100000:2.0:1783951360.890036:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923956352 00000100:00100000:2.0:1783951360.890249:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923956480 00000100:00100000:2.0:1783951360.890253:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923956480 00000100:00080000:0.0:1783951360.890391:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783951360.890395:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951360.890470:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923956096 00000100:00100000:1.0:1783951360.890475:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923956096 00000100:00100000:1.0:1783951360.890511:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 9 00000100:00100000:1.0:1783951360.890521:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:0:x1870607923956352:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783951360.890562:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783951360.890648:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:0:x1870607923956352:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 128us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951360.890655:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 9 00000100:00100000:1.0:1783951360.890672:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00100000:1.0:1783951360.890678:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+7:0:x1870607923956096:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783951360.890694:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783951360.890737:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+7:0:x1870607923956096:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 58us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951360.890743:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00100000:2.0:1783951360.891110:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:2.0:1783951360.891118:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:18102:x1870607923956480:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783951360.891131:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783951360.891188:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:18102:x1870607923956480:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 70us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951360.891194:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:1.0:1783951360.896352:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951360.897067:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923956608 00000100:00100000:2.0:1783951360.897255:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923956608 00000100:00100000:2.0:1783951360.897320:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:2.0:1783951360.897332:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:18102:x1870607923956608:12345-192.168.202.33@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783951360.902027:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:18102:x1870607923956608:12345-192.168.202.33@tcp:40:mount.lustre.0 Request processed in 4683us (5670us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951360.902044:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:1.0:1783951360.905297:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951360.905336:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951360.905444:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951360.905548:0:24810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923956736 00000100:00100000:2.0:1783951360.905557:0:24810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923956736 00000100:00100000:2.0:1783951360.905610:0:24810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923956864 00000100:00100000:2.0:1783951360.905613:0:24810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923956864 00000100:00100000:2.0:1783951360.905635:0:24810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:2.0:1783951360.905644:0:24810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1870607923956736:12345-192.168.202.33@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783951360.905687:0:24810:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from a3b69357-ecfd-411d-bcaf-eec1ed5aa77c@192.168.202.33@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:2.0:1783951360.905734:0:24810:0:(genops.c:1406:class_connect()) connect: client a3b69357-ecfd-411d-bcaf-eec1ed5aa77c, cookie 0x7645c8e1169f9ef5 00002000:00100000:2.0:1783951360.905747:0:24810:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a3b69357-ecfd-411d-bcaf-eec1ed5aa77c/ffff9e0247763000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783951360.905769:0:24810:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783951360.905941:0:24810:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783951360.905971:0:24810:0:(import.c:65:import_set_state_nolock()) ffff9e0247761800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951360.906038:0:24810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:2406:x1870607923956736:12345-192.168.202.33@tcp:8:mount.lustre.0 Request processed in 393us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951360.906046:0:24810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:2.0:1783951360.906064:0:24810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:2.0:1783951360.906069:0:24810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1870607923956864:12345-192.168.202.33@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783951360.906108:0:24810:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from a3b69357-ecfd-411d-bcaf-eec1ed5aa77c@192.168.202.33@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:2.0:1783951360.906126:0:24810:0:(genops.c:1406:class_connect()) connect: client a3b69357-ecfd-411d-bcaf-eec1ed5aa77c, cookie 0x7645c8e1169f9efc 00002000:00100000:2.0:1783951360.906136:0:24810:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a3b69357-ecfd-411d-bcaf-eec1ed5aa77c/ffff9e0247762000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783951360.906187:0:24810:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783951360.906296:0:24810:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783951360.906313:0:24810:0:(import.c:65:import_set_state_nolock()) ffff9e0247761000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951360.906346:0:24810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:2406:x1870607923956864:12345-192.168.202.33@tcp:8:mount.lustre.0 Request processed in 275us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951360.906354:0:24810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:0.0:1783951360.906505:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923956992 00000100:00100000:0.0:1783951360.906510:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923956992 00000100:00100000:0.0:1783951360.906548:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:0.0:1783951360.906562:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:18102:x1870607923956992:12345-192.168.202.33@tcp:900:mount.lustre.0 00000100:00100000:0.0:1783951360.906654:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:18102:x1870607923956992:12345-192.168.202.33@tcp:900:mount.lustre.0 Request processed in 93us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951360.906661:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:3.0:1783951360.908448:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951360.908631:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923957120 00000100:00100000:1.0:1783951360.908640:0:22779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923957120 00000100:00100000:1.0:1783951360.908737:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:1.0:1783951360.908750:0:22779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036ae29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:18102:x1870607923957120:12345-192.168.202.33@tcp:33:mount.lustre.0 00000004:00080000:1.0:1783951360.912085:0:22779:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3246us 00000004:00200000:3.0:1783951360.951900:0:22779:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783951360.953066:0:22779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036ae29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:18102:x1870607923957120:12345-192.168.202.33@tcp:33:mount.lustre.0 Request processed in 44311us (44616us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951360.953085:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 0 00000040:00080000:3.0:1783951360.993291:0:22812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783951361.174519:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951361.174623:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923957248 00000100:00100000:3.0:1783951361.174632:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923957248 00000100:00100000:3.0:1783951361.174695:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:3.0:1783951361.174707:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:18148:x1870607923957248:12345-192.168.202.33@tcp:101:mkdir.0 00010000:00010000:3.0:1783951361.174728:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951361.174755:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f9f03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fb82 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951361.174828:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f9f0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951361.174843:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f9f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951361.174872:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f9f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951361.174932:0:22778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783951361.174936:0:22778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783951361.174970:0:22778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f9f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951361.174998:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608200/0x7645c8e1169f9f03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb82 expref: 8 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951361.175016:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f9f0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb82 expref: 7 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951361.175025:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e024109bc00) 00010000:00010000:3.0:1783951361.175028:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951361.175031:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608400, rc 0) 00000100:00100000:3.0:1783951361.175989:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+7:18148:x1870607923957248:12345-192.168.202.33@tcp:101:mkdir.0 Request processed in 1278us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951361.175999:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 13 00010000:00010000:0.0:1783951361.568612:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951361.632543:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945037568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951361.632613:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951361.632676:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945037568 00000100:00100000:2.0:1783951361.632685:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945037568 00000100:00100000:2.0:1783951361.632753:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783951361.632763:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036ae28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945037568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951361.632785:0:24285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783951361.632842:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036ae28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945037568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951361.632849:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783951361.632916:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945037568:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783951361.632981:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783951362.592321:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951362.657030:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951362.657054:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e034121a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607945037696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951362.657163:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951362.657478:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945037824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951362.657508:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951362.657588:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945037696 00000100:00100000:1.0:1783951362.657595:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945037696 00000100:00100000:1.0:1783951362.657636:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945037824 00000100:00100000:1.0:1783951362.657640:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945037824 00000100:00100000:1.0:1783951362.657657:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783951362.657666:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607945037696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783951362.657700:0:22783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783951362.657757:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607945037696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951362.657764:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783951362.657780:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783951362.657797:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607945037824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783951362.657815:0:22783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783951362.657844:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607945037824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951362.657851:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783951362.657976:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945037824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951362.657989:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e034121a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607945037696:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951363.331391:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951363.331643:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923957376 00000100:00100000:2.0:1783951363.331653:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923957376 00000100:00100000:2.0:1783951363.331729:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00100000:2.0:1783951363.331739:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036ae29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+7:18200:x1870607923957376:12345-192.168.202.33@tcp:41:lfs.0 00000004:00000024:2.0:1783951363.331771:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783951363.331885:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036ae29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+7:18200:x1870607923957376:12345-192.168.202.33@tcp:41:lfs.0 Request processed in 147us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951363.331900:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00080000:0.0:1783951363.332019:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951363.352704:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951363.352880:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923957504 00000100:00100000:3.0:1783951363.352891:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923957504 00000100:00100000:3.0:1783951363.352976:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00100000:3.0:1783951363.352987:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:18200:x1870607923957504:12345-192.168.202.33@tcp:41:lfs.0 00000004:00000024:3.0:1783951363.353035:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783951363.353136:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:18200:x1870607923957504:12345-192.168.202.33@tcp:41:lfs.0 Request processed in 150us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951363.353173:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00080000:0.0:1783951363.353645:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951363.357314:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951363.357606:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923957632 00000100:00100000:2.0:1783951363.357617:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923957632 00000100:00100000:2.0:1783951363.357703:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00100000:2.0:1783951363.357714:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036ae29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:18200:x1870607923957632:12345-192.168.202.33@tcp:13:lfs.0 00002000:00000024:2.0:1783951363.357753:0:24285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783951363.357836:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036ae29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:18200:x1870607923957632:12345-192.168.202.33@tcp:13:lfs.0 Request processed in 123us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951363.357843:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00080000:0.0:1783951363.357930:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951363.362219:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951363.363322:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923957760 00000100:00100000:2.0:1783951363.363334:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923957760 00000100:00100000:2.0:1783951363.363406:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:2.0:1783951363.363416:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:18200:x1870607923957760:12345-192.168.202.33@tcp:13:lfs.0 00002000:00000024:2.0:1783951363.363455:0:24285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1783951363.363546:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:18200:x1870607923957760:12345-192.168.202.33@tcp:13:lfs.0 Request processed in 130us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951363.363554:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00080000:1.0:1783951363.363918:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951363.602796:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951363.602893:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923957888 00000100:00100000:1.0:1783951363.602903:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923957888 00000100:00100000:1.0:1783951363.602959:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 129 00000100:00100000:1.0:1783951363.602968:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ca49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+10:18232:x1870607923957888:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783951363.602985:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951363.603001:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a66200/0x7645c8e1169f9f11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fb89 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951363.603049:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a66200/0x7645c8e1169f9f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb89 expref: 11 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951363.603060:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a66200/0x7645c8e1169f9f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb89 expref: 11 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951363.603096:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66200, rc 0) 00000100:00100000:1.0:1783951363.603196:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ca49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+11:18232:x1870607923957888:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 227us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951363.603204:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 129 00010000:00010000:0.0:1783951363.616380:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951363.623053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951363.623239:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923958016 00000100:00100000:0.0:1783951363.623249:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923958016 00000100:00100000:0.0:1783951363.623341:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 130 00000100:00100000:0.0:1783951363.623352:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ca48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+11:18232:x1870607923958016:12345-192.168.202.33@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783951363.623535:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ca48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+11:18232:x1870607923958016:12345-192.168.202.33@tcp:501:mount.lustre.0 Request processed in 184us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951363.623544:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 130 00000100:00100000:3.0:1783951363.636003:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951363.636332:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923958144 00000100:00100000:1.0:1783951363.636342:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923958144 00000100:00100000:1.0:1783951363.636399:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 131 00000100:00100000:1.0:1783951363.636409:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ca49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+11:18232:x1870607923958144:12345-192.168.202.33@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783951363.636559:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ca49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+11:18232:x1870607923958144:12345-192.168.202.33@tcp:503:mount.lustre.0 Request processed in 151us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951363.636568:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 131 00000100:00100000:1.0:1783951363.650259:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951363.650357:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923958272 00000100:00100000:0.0:1783951363.650367:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923958272 00000100:00100000:0.0:1783951363.650461:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 132 00000100:00100000:0.0:1783951363.650472:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+11:18239:x1870607923958272:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783951363.650654:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+11:18239:x1870607923958272:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 183us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951363.650663:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 132 00000100:00100000:2.0:1783951363.675368:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951363.675472:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923958400 00000100:00100000:3.0:1783951363.675483:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923958400 00000100:00100000:3.0:1783951363.675541:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 133 00000100:00100000:3.0:1783951363.675551:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+11:18239:x1870607923958400:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783951363.675807:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+11:18239:x1870607923958400:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 256us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951363.675816:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 133 00000100:00100000:3.0:1783951363.687400:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951363.687772:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923958528 00000100:00100000:0.0:1783951363.687782:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923958528 00000100:00100000:0.0:1783951363.688303:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 134 00000100:00100000:0.0:1783951363.688316:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+11:18239:x1870607923958528:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783951363.688597:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+11:18239:x1870607923958528:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 283us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951363.688607:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 134 00000100:00100000:0.0:1783951363.694806:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951363.694942:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923958656 00000100:00100000:1.0:1783951363.694952:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923958656 00000100:00100000:1.0:1783951363.695010:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 135 00000100:00100000:1.0:1783951363.695021:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+11:18232:x1870607923958656:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783951363.695039:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951363.695060:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a67400/0x7645c8e1169f9f18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fbba expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951363.695123:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a67400/0x7645c8e1169f9f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbba expref: 12 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951363.695134:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a67400/0x7645c8e1169f9f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbba expref: 12 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951363.695179:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67400, rc 0) 00000100:00100000:1.0:1783951363.695249:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+12:18232:x1870607923958656:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 228us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951363.695257:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 135 00000100:00100000:2.0:1783951363.700317:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951363.701123:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923958784 00000100:00100000:0.0:1783951363.701135:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923958784 00000100:00100000:0.0:1783951363.701234:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 136 00000100:00100000:0.0:1783951363.701246:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+12:18232:x1870607923958784:12345-192.168.202.33@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783951363.701275:0:22769:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783951363.701298:0:22769:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783951363.701302:0:22769:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783951363.701306:0:22769:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783951363.701309:0:22769:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783951363.701311:0:22769:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1783951363.704548:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+12:18232:x1870607923958784:12345-192.168.202.33@tcp:256:mount.lustre.0 Request processed in 2827us (3764us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951363.704563:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 136 00000100:00100000:2.0:1783951363.708343:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951363.708569:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923958912 00000100:00100000:3.0:1783951363.708580:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923958912 00000100:00100000:3.0:1783951363.708738:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 137 00000100:00100000:3.0:1783951363.708749:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+12:18232:x1870607923958912:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783951363.708767:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951363.708785:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9f1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fbc1 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951363.708813:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9f1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbc1 expref: 13 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951363.708823:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9f1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbc1 expref: 13 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951363.708845:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608200, rc 0) 00000100:00100000:3.0:1783951363.708903:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:18232:x1870607923958912:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 156us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951363.708910:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 137 00000100:00100000:2.0:1783951363.713436:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951363.713533:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923959040 00000100:00100000:0.0:1783951363.713543:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923959040 00000100:00100000:0.0:1783951363.713601:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 138 00000100:00100000:0.0:1783951363.713612:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:18232:x1870607923959040:12345-192.168.202.33@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783951363.713896:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:18232:x1870607923959040:12345-192.168.202.33@tcp:501:mount.lustre.0 Request processed in 285us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951363.715019:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 138 00000100:00100000:2.0:1783951363.722015:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951363.724222:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923959168 00000100:00100000:3.0:1783951363.724236:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923959168 00000100:00100000:3.0:1783951363.724313:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 139 00000100:00100000:3.0:1783951363.724325:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:18232:x1870607923959168:12345-192.168.202.33@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783951363.724498:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:18232:x1870607923959168:12345-192.168.202.33@tcp:503:mount.lustre.0 Request processed in 175us (2493us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951363.724508:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 139 00000100:00100000:2.0:1783951363.729941:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951363.730104:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923959296 00000100:00100000:0.0:1783951363.730115:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923959296 00000100:00100000:0.0:1783951363.730189:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 140 00000100:00100000:0.0:1783951363.730199:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:18244:x1870607923959296:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783951363.730361:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:18244:x1870607923959296:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 163us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951363.730369:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 140 00000100:00100000:2.0:1783951363.733247:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951363.733627:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923959424 00000100:00100000:1.0:1783951363.733636:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923959424 00000100:00100000:1.0:1783951363.733732:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 141 00000100:00100000:1.0:1783951363.733743:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:18244:x1870607923959424:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783951363.733901:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:18244:x1870607923959424:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 159us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951363.733908:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 141 00000100:00100000:2.0:1783951363.738940:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951363.738982:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951363.739009:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951363.739029:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951363.739045:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951363.739082:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951363.739110:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923960448 00000100:00100000:2.0:1783951363.739119:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923960448 00000100:00100000:2.0:1783951363.739197:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923960576 00000100:00100000:2.0:1783951363.739200:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923960576 00000100:00100000:2.0:1783951363.739223:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:2.0:1783951363.739233:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:2407:x1870607923960448:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951363.739303:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:2407:x1870607923960448:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 71us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951363.739310:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:2.0:1783951363.739329:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:2.0:1783951363.739335:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:2407:x1870607923960576:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951363.739374:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:2407:x1870607923960576:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 38us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951363.739381:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:2.0:1783951363.739404:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923960192 00000100:00100000:2.0:1783951363.739408:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923960192 00000100:00100000:2.0:1783951363.739426:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923960320 00000100:00100000:2.0:1783951363.739430:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923960320 00000100:00100000:2.0:1783951363.739439:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923959552 00000100:00100000:2.0:1783951363.739441:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923959552 00000100:00100000:2.0:1783951363.739450:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923959808 00000100:00100000:2.0:1783951363.739453:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923959808 00000100:00100000:2.0:1783951363.739471:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 34 00000100:00100000:2.0:1783951363.739476:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0248608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+7:2407:x1870607923960192:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951363.739500:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0248608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+7:2407:x1870607923960192:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 25us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951363.739506:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 34 00000100:00100000:2.0:1783951363.739516:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 35 00000100:00100000:2.0:1783951363.739521:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:2407:x1870607923960320:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951363.739538:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:2407:x1870607923960320:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 17us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951363.739543:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 35 00000100:00100000:2.0:1783951363.739554:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:2.0:1783951363.739558:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1870607923959552:12345-192.168.202.33@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783951363.739579:0:22776:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 62ee916a-a3ac-448f-ada8-d39e07682174@192.168.202.33@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:2.0:1783951363.739617:0:22776:0:(genops.c:1406:class_connect()) connect: client 62ee916a-a3ac-448f-ada8-d39e07682174, cookie 0x7645c8e1169f9f26 00000004:00100000:2.0:1783951363.739646:0:22776:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783951363.739738:0:22776:0:(import.c:65:import_set_state_nolock()) ffff9e036b6b9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951363.739767:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee916a-a3ac-448f-ada8-d39e07682174+6:2406:x1870607923959552:12345-192.168.202.33@tcp:38:mount.lustre.0 Request processed in 207us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951363.739774:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:2.0:1783951363.739788:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:2.0:1783951363.739792:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1870607923959808:12345-192.168.202.33@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783951363.739806:0:22776:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 62ee916a-a3ac-448f-ada8-d39e07682174@192.168.202.33@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:2.0:1783951363.739828:0:22776:0:(genops.c:1406:class_connect()) connect: client 62ee916a-a3ac-448f-ada8-d39e07682174, cookie 0x7645c8e1169f9f2d 00000004:00100000:2.0:1783951363.739841:0:22776:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783951363.739889:0:22776:0:(import.c:65:import_set_state_nolock()) ffff9e036b6bb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951363.739912:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee916a-a3ac-448f-ada8-d39e07682174+6:2406:x1870607923959808:12345-192.168.202.33@tcp:38:mount.lustre.0 Request processed in 118us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951363.739918:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:2.0:1783951363.748971:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951363.749078:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923960064 00000100:00100000:0.0:1783951363.749088:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923960064 00000100:00100000:0.0:1783951363.749188:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:0.0:1783951363.749199:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee916a-a3ac-448f-ada8-d39e07682174+6:18232:x1870607923960064:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783951363.749239:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783951363.749321:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee916a-a3ac-448f-ada8-d39e07682174+6:18232:x1870607923960064:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 123us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951363.749329:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00080000:1.0:1783951363.751921:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1783951363.755245:0:23527:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783951363.756202:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951363.756335:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951363.756473:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951363.760980:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923959936 00000100:00100000:0.0:1783951363.761223:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923959936 00000100:00100000:0.0:1783951363.761357:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923959680 00000100:00100000:0.0:1783951363.761360:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923959680 00000100:00100000:0.0:1783951363.761368:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923960704 00000100:00100000:0.0:1783951363.761370:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923960704 00000100:00100000:0.0:1783951363.761382:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:0.0:1783951363.761389:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee916a-a3ac-448f-ada8-d39e07682174+6:0:x1870607923959936:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783951363.761424:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783951363.761493:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee916a-a3ac-448f-ada8-d39e07682174+6:0:x1870607923959936:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 103us (5297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951363.761514:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:0.0:1783951363.761532:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:0.0:1783951363.761537:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee916a-a3ac-448f-ada8-d39e07682174+7:0:x1870607923959680:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783951363.761548:0:22776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783951363.761568:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee916a-a3ac-448f-ada8-d39e07682174+7:0:x1870607923959680:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 32us (5235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951363.761572:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:0.0:1783951363.761583:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:0.0:1783951363.761589:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee916a-a3ac-448f-ada8-d39e07682174+6:18232:x1870607923960704:12345-192.168.202.33@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783951363.761618:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee916a-a3ac-448f-ada8-d39e07682174+6:18232:x1870607923960704:12345-192.168.202.33@tcp:40:mount.lustre.0 Request processed in 29us (5145us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951363.761623:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00080000:2.0:1783951363.761954:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951363.769408:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951363.769452:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951363.769473:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951363.769548:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923961088 00000100:00100000:3.0:1783951363.769558:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923961088 00000100:00100000:3.0:1783951363.769612:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:3.0:1783951363.769622:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:62ee916a-a3ac-448f-ada8-d39e07682174+6:18232:x1870607923961088:12345-192.168.202.33@tcp:900:mount.lustre.0 00000100:00100000:3.0:1783951363.769708:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:62ee916a-a3ac-448f-ada8-d39e07682174+6:18232:x1870607923961088:12345-192.168.202.33@tcp:900:mount.lustre.0 Request processed in 86us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951363.769716:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:2.0:1783951363.772216:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923960832 00000100:00100000:2.0:1783951363.772230:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923960832 00000100:00100000:2.0:1783951363.772297:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923960960 00000100:00100000:2.0:1783951363.772301:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923960960 00000100:00100000:2.0:1783951363.772344:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:2.0:1783951363.772354:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2406:x1870607923960832:12345-192.168.202.33@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783951363.772391:0:24281:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 62ee916a-a3ac-448f-ada8-d39e07682174@192.168.202.33@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:2.0:1783951363.772421:0:24281:0:(genops.c:1406:class_connect()) connect: client 62ee916a-a3ac-448f-ada8-d39e07682174, cookie 0x7645c8e1169f9f34 00002000:00100000:2.0:1783951363.772447:0:24281:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 62ee916a-a3ac-448f-ada8-d39e07682174/ffff9e03779c1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783951363.772461:0:24281:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783951363.772534:0:24281:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783951363.772568:0:24281:0:(import.c:65:import_set_state_nolock()) ffff9e03779c5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951363.772633:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ee916a-a3ac-448f-ada8-d39e07682174+6:2406:x1870607923960832:12345-192.168.202.33@tcp:8:mount.lustre.0 Request processed in 279us (3179us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951363.772640:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:2.0:1783951363.772658:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:2.0:1783951363.772663:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2406:x1870607923960960:12345-192.168.202.33@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783951363.772697:0:24281:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 62ee916a-a3ac-448f-ada8-d39e07682174@192.168.202.33@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:2.0:1783951363.772715:0:24281:0:(genops.c:1406:class_connect()) connect: client 62ee916a-a3ac-448f-ada8-d39e07682174, cookie 0x7645c8e1169f9f3b 00002000:00100000:2.0:1783951363.772721:0:24281:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 62ee916a-a3ac-448f-ada8-d39e07682174/ffff9e03779c3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783951363.772726:0:24281:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783951363.774591:0:24281:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783951363.774634:0:24281:0:(import.c:65:import_set_state_nolock()) ffff9e0380bb8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951363.774710:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ee916a-a3ac-448f-ada8-d39e07682174+6:2406:x1870607923960960:12345-192.168.202.33@tcp:8:mount.lustre.0 Request processed in 2043us (5233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951363.774721:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:0.0:1783951363.777174:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951363.777337:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923961216 00000100:00100000:2.0:1783951363.777347:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923961216 00000100:00100000:2.0:1783951363.777406:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 1 00000100:00100000:2.0:1783951363.777416:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ee916a-a3ac-448f-ada8-d39e07682174+6:18232:x1870607923961216:12345-192.168.202.33@tcp:33:mount.lustre.0 00000004:00200000:2.0:1783951363.777512:0:22780:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783951363.777590:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ee916a-a3ac-448f-ada8-d39e07682174+6:18232:x1870607923961216:12345-192.168.202.33@tcp:33:mount.lustre.0 Request processed in 174us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951363.777598:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 1 00000100:00100000:2.0:1783951363.970394:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951363.972546:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923961344 00000100:00100000:0.0:1783951363.972561:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923961344 00000100:00100000:0.0:1783951363.972643:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:0.0:1783951363.972654:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee916a-a3ac-448f-ada8-d39e07682174+6:18267:x1870607923961344:12345-192.168.202.33@tcp:101:mkdir.0 00010000:00010000:0.0:1783951363.972691:0:22776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951363.972715:0:22776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169f9f42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fbf2 expref: -99 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951363.972798:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169f9f49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951363.972814:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169f9f49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951363.972828:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169f9f49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951363.972890:0:22776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783951363.972895:0:22776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783951363.972919:0:22776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169f9f49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951363.972947:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169f9f42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbf2 expref: 8 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951363.972966:0:22776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169f9f49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbf2 expref: 7 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951363.972975:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e024109bc00) 00010000:00010000:0.0:1783951363.972978:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783951363.972981:0:22776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2e00, rc 0) 00000100:00100000:0.0:1783951363.973131:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee916a-a3ac-448f-ada8-d39e07682174+7:18267:x1870607923961344:12345-192.168.202.33@tcp:101:mkdir.0 Request processed in 478us (2749us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951363.973139:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:3.0:1783951364.192760:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945038208:0@lo:400:kworker.0 00000100:00100000:3.0:1783951364.192848:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951364.192922:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945038720:0@lo:400:kworker.0 00000100:00100000:3.0:1783951364.192945:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951364.192980:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607945039232:0@lo:400:kworker.0 00000100:00100000:3.0:1783951364.193018:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951364.193046:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783951364.193052:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945038336:0@lo:400:kworker.0 00000100:00100000:3.0:1783951364.193088:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951364.193108:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945038848:0@lo:400:kworker.0 00000100:00100000:3.0:1783951364.193127:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951364.193165:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607945039360:0@lo:400:kworker.0 00000100:00100000:3.0:1783951364.193187:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951364.193220:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945038208 00000100:00100000:3.0:1783951364.193226:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945038208 00000100:00100000:3.0:1783951364.193281:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945038720 00000100:00100000:3.0:1783951364.193284:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945038720 00000100:00100000:3.0:1783951364.193297:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945038336 00000100:00100000:3.0:1783951364.193299:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945038336 00000100:00100000:1.0:1783951364.193309:0:25206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945038848 00000100:00100000:1.0:1783951364.193312:0:25206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945038848 00000100:00100000:3.0:1783951364.193316:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783951364.193323:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945038208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.193330:0:25206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783951364.193335:0:25206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945038720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951364.193381:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945038208:12345-0@lo:400:kworker.0 Request processed in 51us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951364.193389:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783951364.193406:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783951364.193412:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945038336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.199218:0:25206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945038720:12345-0@lo:400:kworker.0 Request processed in 5871us (6261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951364.199233:0:25206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783951364.199286:0:25206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783951364.199299:0:25206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945038848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.199381:0:25206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945038848:12345-0@lo:400:kworker.0 Request processed in 87us (6252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951364.199387:0:25206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783951364.199421:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607945038080:0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.199457:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951364.199496:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945038592:0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.199513:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951364.199531:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607945039104:0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.199549:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951364.199566:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945039616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951364.199585:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951364.199608:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1783951364.199614:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b1b2cfa-7097-4258-904b-0084ac551497:3653:1870607945037952:0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.199637:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951364.199657:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607945038464:0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.199674:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951364.199683:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607945038976:0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.199698:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951364.199706:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1870607945039488:0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.199732:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951364.199765:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945038080 00000100:00100000:1.0:1783951364.199771:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945038080 00000100:00100000:1.0:1783951364.199797:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945038592 00000100:00100000:1.0:1783951364.199804:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945038592 00000100:00100000:1.0:1783951364.199816:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783951364.199821:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607945038080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.199853:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607945038080:12345-0@lo:400:kworker.0 Request processed in 31us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951364.199859:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783951364.199869:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783951364.199874:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945038592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.199894:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945038592:12345-0@lo:400:kworker.0 Request processed in 20us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951364.199899:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783951364.199927:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607945038080:0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.199935:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945038592:0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.199957:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945039232 00000100:00100000:1.0:1783951364.199960:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945039232 00000100:00100000:1.0:1783951364.199978:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945039360 00000100:00100000:1.0:1783951364.199980:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945039360 00000100:00100000:1.0:1783951364.199989:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945039104 00000100:00100000:1.0:1783951364.199991:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945039104 00000100:00100000:1.0:1783951364.200000:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945038464 00000100:00100000:1.0:1783951364.200002:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945038464 00000100:00100000:1.0:1783951364.200010:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945038976 00000100:00100000:1.0:1783951364.200012:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945038976 00000100:00100000:1.0:1783951364.200020:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945039488 00000100:00100000:1.0:1783951364.200022:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945039488 00000100:00100000:1.0:1783951364.200032:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783951364.200037:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607945039232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.200063:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607945039232:12345-0@lo:400:kworker.0 Request processed in 26us (7045us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951364.200088:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783951364.200103:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783951364.200109:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0349480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607945039360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.200160:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607945039360:12345-0@lo:400:kworker.0 Request processed in 31us (6951us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951364.200166:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783951364.200177:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783951364.200182:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607945039104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.200212:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1870607945039104:12345-0@lo:400:kworker.0 Request processed in 30us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951364.200217:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783951364.200233:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783951364.200239:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607945038464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.200261:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1870607945038464:12345-0@lo:400:kworker.0 Request processed in 23us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951364.200267:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783951364.200277:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783951364.200288:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607945038976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.200313:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1870607945038976:12345-0@lo:400:kworker.0 Request processed in 25us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951364.200317:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783951364.200327:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783951364.200333:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1870607945039488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.200360:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1870607945039488:12345-0@lo:400:kworker.0 Request processed in 27us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951364.200374:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783951364.200402:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3653:1870607945038464:0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.200411:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3653:1870607945038976:0@lo:400:kworker.0 00010000:00080000:1.0:1783951364.200422:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e036ae29c00 x1870607945039488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951364.200432:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3653:1870607945039488:0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.200441:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3653:1870607945039104:0@lo:400:kworker.0 00000100:00100000:3.0:1783951364.200824:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0349482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945038336:12345-0@lo:400:kworker.0 Request processed in 7409us (7733us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951364.200833:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783951364.200863:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945039744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951364.200894:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951364.200938:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945038336:0@lo:400:kworker.0 00000100:00100000:3.0:1783951364.200950:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945038848:0@lo:400:kworker.0 00000100:00100000:3.0:1783951364.200962:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607945039360:0@lo:400:kworker.0 00000100:00100000:3.0:1783951364.200974:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945038208:0@lo:400:kworker.0 00000100:00100000:3.0:1783951364.200986:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945038720:0@lo:400:kworker.0 00010000:00080000:3.0:1783951364.200996:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e036ae2ad80 x1870607945039232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951364.201005:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607945039232:0@lo:400:kworker.0 00000100:00100000:3.0:1783951364.201030:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951364.201036:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0341218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945039872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951364.201058:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951364.201097:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945037952 00000100:00100000:3.0:1783951364.201101:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945037952 00000100:00100000:3.0:1783951364.201132:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783951364.201138:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+24:3653:x1870607945037952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951364.201198:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+24:3653:x1870607945037952:12345-0@lo:400:kworker.0 Request processed in 60us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951364.201204:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:3.0:1783951364.201247:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783951364.201251:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783951364.201254:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951364.201257:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951364.201275:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945039616 00000100:00100000:3.0:1783951364.201278:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945039616 00000100:00100000:3.0:1783951364.201295:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945039744 00000100:00100000:3.0:1783951364.201303:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945039744 00000100:00100000:3.0:1783951364.201315:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945039872 00000100:00100000:3.0:1783951364.201317:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945039872 00000100:00100000:3.0:1783951364.201328:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783951364.201333:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945039616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783951364.201351:0:24285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1783951364.201386:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945039616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (1800us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951364.201392:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783951364.201403:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783951364.201409:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945039744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951364.201417:0:24285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1783951364.201444:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945039744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951364.201450:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783951364.201460:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783951364.201465:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945039872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951364.201475:0:24285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783951364.201500:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945039872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951364.201506:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783951364.201535:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0341218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945039872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951364.201547:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945039744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951364.201672:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b1b2cfa-7097-4258-904b-0084ac551497:3653:1870607945037952:0@lo:400:kworker.0 00000100:00100000:1.0:1783951364.201688:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945039616:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783951364.641211:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951365.664432:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783951366.241827:0:24277:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 62ee916a-a3ac-448f-ada8-d39e07682174 00000001:00100000:1.0:1783951366.241839:0:24277:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a3b69357-ecfd-411d-bcaf-eec1ed5aa77c 00000001:00100000:2.0:1783951366.245755:0:22757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 62ee916a-a3ac-448f-ada8-d39e07682174 00000001:00100000:2.0:1783951366.245770:0:22757:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a3b69357-ecfd-411d-bcaf-eec1ed5aa77c 00000001:00100000:3.0:1783951366.246547:0:23509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 62ee916a-a3ac-448f-ada8-d39e07682174 00000001:00100000:3.0:1783951366.246555:0:23509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a3b69357-ecfd-411d-bcaf-eec1ed5aa77c 00000001:00100000:3.0:1783951366.252537:0:25097:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 62ee916a-a3ac-448f-ada8-d39e07682174 00000001:00100000:3.0:1783951366.252550:0:25097:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a3b69357-ecfd-411d-bcaf-eec1ed5aa77c 00010000:00010000:2.0:1783951366.689727:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951366.752282:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951366.752307:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945040000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951366.752377:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951366.752428:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945040000 00000100:00100000:1.0:1783951366.752435:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945040000 00000100:00100000:1.0:1783951366.753660:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783951366.753691:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945040000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783951366.753726:0:24285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783951366.753795:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945040000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951366.753813:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783951366.753862:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945040000:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783951366.758232:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1783951366.878537:0:25655:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1783951367.712758:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951367.778980:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951367.779014:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e034121b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945040128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951367.779134:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951367.779343:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945040128 00000100:00100000:0.0:1783951367.779354:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945040128 00000100:00100000:0.0:1783951367.779421:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783951367.779434:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607945040128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783951367.779493:0:22783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783951367.779572:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607945040128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951367.779580:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783951367.779884:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e034121b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945040128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951367.780054:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951367.780067:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945040256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951367.780106:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951367.780522:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945040256 00000100:00100000:0.0:1783951367.780529:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945040256 00000100:00100000:0.0:1783951367.780576:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783951367.780583:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607945040256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783951367.780612:0:22783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783951367.780668:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607945040256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951367.780676:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783951367.780812:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945040256:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783951368.740060:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951368.962665:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951368.962760:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951368.962804:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951368.962861:0:25206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923961856 00000100:00100000:2.0:1783951368.962879:0:25206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923961856 00000100:00100000:2.0:1783951368.962946:0:25206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00100000:2.0:1783951368.962956:0:25206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+5:2408:x1870607923961856:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951368.963064:0:25206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+5:2408:x1870607923961856:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 109us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951368.963072:0:25206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00080000:2.0:1783951368.963245:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951368.972758:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951368.972815:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951368.972856:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951368.977496:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923961600 00000100:00100000:1.0:1783951368.977512:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923961600 00000100:00100000:1.0:1783951368.977546:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923962368 00000100:00100000:1.0:1783951368.977550:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923962368 00000100:00100000:1.0:1783951368.977647:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:1.0:1783951368.977659:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ee916a-a3ac-448f-ada8-d39e07682174+5:2408:x1870607923962368:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951368.977744:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ee916a-a3ac-448f-ada8-d39e07682174+5:2408:x1870607923962368:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 87us (4995us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951368.977751:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:1.0:1783951368.977927:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923962112 00000100:00100000:1.0:1783951368.977931:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923962112 00000100:00100000:1.0:1783951368.977951:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 42 00000100:00100000:1.0:1783951368.977958:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:2408:x1870607923961600:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951368.978513:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:2408:x1870607923961600:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 553us (15854us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951368.978521:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 42 00000100:00100000:1.0:1783951368.978540:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 43 00000100:00100000:1.0:1783951368.978548:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037fc67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ee916a-a3ac-448f-ada8-d39e07682174+6:2408:x1870607923962112:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951368.978573:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037fc67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ee916a-a3ac-448f-ada8-d39e07682174+6:2408:x1870607923962112:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 28us (15769us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951368.978579:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 43 00000100:00100000:1.0:1783951368.978716:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923961472 00000100:00100000:1.0:1783951368.978722:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923961472 00000100:00100000:1.0:1783951368.978750:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 143 00000100:00100000:1.0:1783951368.978757:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:2408:x1870607923961472:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951368.978843:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:2408:x1870607923961472:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (6028us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951368.978850:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 143 00000100:00080000:1.0:1783951368.978930:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783951368.978935:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951368.979715:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951368.979736:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923961984 00000100:00100000:3.0:1783951368.979741:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923961984 00000100:00100000:3.0:1783951368.980708:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:3.0:1783951368.980723:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+5:2408:x1870607923961984:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951368.980898:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923961728 00000100:00100000:1.0:1783951368.980904:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923961728 00000100:00100000:1.0:1783951368.980939:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 44 00000100:00100000:1.0:1783951368.980947:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+5:2408:x1870607923961728:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951368.980994:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+5:2408:x1870607923961728:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 48us (8137us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951368.981002:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 44 00000100:00100000:1.0:1783951368.981069:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951368.981569:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951368.981595:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923962240 00000100:00100000:1.0:1783951368.981599:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923962240 00000100:00100000:1.0:1783951368.981624:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 45 00000100:00100000:1.0:1783951368.981630:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ee916a-a3ac-448f-ada8-d39e07682174+5:2408:x1870607923962240:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951368.981662:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ee916a-a3ac-448f-ada8-d39e07682174+5:2408:x1870607923962240:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 32us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951368.981669:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 45 00000100:00100000:1.0:1783951368.981729:0:25206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923962496 00000100:00100000:1.0:1783951368.981746:0:25206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923962496 00000100:00100000:2.0:1783951368.981899:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:2.0:1783951368.981909:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ee916a-a3ac-448f-ada8-d39e07682174+5:2408:x1870607923962496:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951368.981943:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62ee916a-a3ac-448f-ada8-d39e07682174+5:2408:x1870607923962496:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 36us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951368.981949:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00080000:2.0:1783951368.982041:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783951368.982045:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951368.982681:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+5:2408:x1870607923961984:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 1959us (2966us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951368.982688:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:0.0:1783951369.318844:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e024860ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945040512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951369.318927:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951369.319294:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945040512 00000100:00100000:1.0:1783951369.319303:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945040512 00000100:00100000:1.0:1783951369.319353:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783951369.319363:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607945040512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951369.319395:0:24285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1783951369.319444:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607945040512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951369.319452:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783951369.319508:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e024860ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945040512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951369.321445:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951369.321473:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0341219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945040640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951369.321539:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951369.321638:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945040640 00000100:00100000:0.0:1783951369.321645:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945040640 00000100:00100000:0.0:1783951369.321696:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783951369.321705:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945040640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951369.321728:0:24285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1783951369.321775:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945040640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951369.321781:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783951369.321911:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0341219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945040640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951369.322278:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945041024:0@lo:400:kworker.0 00000100:00100000:1.0:1783951369.322308:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951369.322346:0:24810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945041024 00000100:00100000:1.0:1783951369.322350:0:24810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945041024 00000100:00100000:1.0:1783951369.322381:0:24810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783951369.322390:0:24810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607945041024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951369.322423:0:24810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607945041024:12345-0@lo:400:kworker.0 Request processed in 36us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951369.322430:0:24810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783951369.322452:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945041024:0@lo:400:kworker.0 00000100:00100000:1.0:1783951369.322478:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951369.322484:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607945041152:0@lo:400:kworker.0 00000100:00100000:1.0:1783951369.322524:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951369.322549:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945041152 00000100:00100000:1.0:1783951369.322552:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945041152 00000100:00100000:1.0:1783951369.322575:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783951369.322581:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607945041152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951369.322613:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607945041152:12345-0@lo:400:kworker.0 Request processed in 32us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951369.322619:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783951369.322644:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607945041152:0@lo:400:kworker.0 00000100:00100000:1.0:1783951369.322682:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607945041536:0@lo:400:kworker.0 00000100:00100000:1.0:1783951369.322703:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951369.322742:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951369.322747:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607945041664:0@lo:400:kworker.0 00000100:00100000:1.0:1783951369.322768:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951369.322787:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945041536 00000100:00100000:1.0:1783951369.322790:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945041536 00000100:00100000:1.0:1783951369.322807:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945041664 00000100:00100000:1.0:1783951369.322810:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945041664 00000100:00100000:1.0:1783951369.322825:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783951369.322831:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607945041536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951369.322861:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607945041536:12345-0@lo:400:kworker.0 Request processed in 30us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951369.322867:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783951369.322878:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783951369.322884:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607945041664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951369.322908:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607945041664:12345-0@lo:400:kworker.0 Request processed in 25us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951369.322920:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783951369.322947:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607945041664:0@lo:400:kworker.0 00000100:00100000:1.0:1783951369.322956:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607945041536:0@lo:400:kworker.0 00000100:00100000:1.0:1783951369.322998:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607945042048:0@lo:400:kworker.0 00000100:00100000:1.0:1783951369.323035:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951369.323057:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945042048 00000100:00100000:1.0:1783951369.323060:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945042048 00000100:00100000:1.0:1783951369.323082:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783951369.323088:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036ae2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607945042048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951369.323120:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036ae2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607945042048:12345-0@lo:400:kworker.0 Request processed in 32us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951369.323126:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1783951369.323173:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e0377abea00 x1870607945042048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951369.323185:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0377abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607945042048:0@lo:400:kworker.0 00000100:00100000:3.0:1783951369.325127:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e034121b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607945040384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951369.325248:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951369.325372:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607945040896:0@lo:400:kworker.0 00000100:00100000:3.0:1783951369.325398:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951369.325437:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945041408:0@lo:400:kworker.0 00000100:00100000:3.0:1783951369.325462:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951369.325482:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607945041920:0@lo:400:kworker.0 00000100:00100000:3.0:1783951369.325505:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951369.325530:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783951369.325536:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b1b2cfa-7097-4258-904b-0084ac551497:3655:1870607945040768:0@lo:400:kworker.0 00000100:00100000:3.0:1783951369.325561:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951369.325585:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945041280:0@lo:400:kworker.0 00000100:00100000:3.0:1783951369.325603:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951369.325631:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607945041792:0@lo:400:kworker.0 00000100:00100000:3.0:1783951369.325649:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951369.326783:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945040896 00000100:00100000:3.0:1783951369.326792:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945040896 00000100:00100000:3.0:1783951369.326830:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945041280 00000100:00100000:3.0:1783951369.326833:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945041280 00000100:00100000:3.0:1783951369.326850:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783951369.334468:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607945040896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951369.334598:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607945040896:12345-0@lo:400:kworker.0 Request processed in 144us (9197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951369.335347:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607945040896:0@lo:400:kworker.0 00000100:00080000:2.0:1783951369.344923:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783951369.344933:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783951369.344936:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783951369.344939:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951369.344953:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945041408 00000100:00100000:2.0:1783951369.344962:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945041408 00000100:00100000:2.0:1783951369.345031:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783951369.345040:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607945041408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951369.345132:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607945041408:12345-0@lo:400:kworker.0 Request processed in 92us (19667us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951369.345157:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783951369.345181:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945041920 00000100:00100000:2.0:1783951369.345185:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945041920 00000100:00100000:2.0:1783951369.345205:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945041792 00000100:00100000:2.0:1783951369.345208:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945041792 00000100:00100000:2.0:1783951369.345222:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783951369.345228:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607945041920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951369.345267:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1870607945041920:12345-0@lo:400:kworker.0 Request processed in 39us (19761us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951369.345273:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783951369.345284:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783951369.345289:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607945041792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951369.345313:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1870607945041792:12345-0@lo:400:kworker.0 Request processed in 24us (19663us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951369.345318:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1783951369.345456:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951369.345459:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783951369.345461:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783951369.345514:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e038112a680 x1870607945041792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951369.345528:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3655:1870607945041792:0@lo:400:kworker.0 00000100:00100000:1.0:1783951369.345543:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945041408:0@lo:400:kworker.0 00000100:00100000:1.0:1783951369.345574:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3655:1870607945041920:0@lo:400:kworker.0 00000100:00100000:1.0:1783951369.346111:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945040384 00000100:00100000:1.0:1783951369.346118:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945040384 00000100:00100000:1.0:1783951369.346182:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783951369.346190:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607945040384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951369.346217:0:24285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783951369.346266:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607945040384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (21018us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951369.346273:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783951369.346329:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e034121b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607945040384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951369.351509:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783951369.351556:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783951369.351571:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607945041280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951369.351704:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607945041280:12345-0@lo:400:kworker.0 Request processed in 139us (26098us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951369.351712:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783951369.351736:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945040768 00000100:00100000:3.0:1783951369.351751:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945040768 00000100:00100000:3.0:1783951369.351791:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783951369.351798:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+24:3655:x1870607945040768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951369.351835:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+24:3655:x1870607945040768:12345-0@lo:400:kworker.0 Request processed in 38us (26273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951369.351842:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783951369.352037:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b1b2cfa-7097-4258-904b-0084ac551497:3655:1870607945040768:0@lo:400:kworker.0 00000100:00100000:2.0:1783951369.352055:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945041280:0@lo:400:kworker.0 00010000:00010000:1.0:1783951369.761288:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783951370.208992:0:22812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783951370.784670:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783951370.988104:0:25802:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee9c2bd90 20000000:00000080:3.0:1783951370.988121:0:25802:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e036ae2c400 uarg=0000000000000000 20000000:01000000:3.0:1783951370.988557:0:25802:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783951370.988562:0:25802:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783951370.988566:0:25802:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783951370.989095:0:25803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1783951370.989369:0:25802:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783951370.998858:0:25802:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783951370.998890:0:25802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e0343608000/0x7645c8e1169f9f50 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951370.998911:0:25802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247949600/0x7645c8e1169f9bad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9ba6 expref: 23 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951370.998919:0:25802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f9bbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9bb4 expref: 23 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951370.998927:0:25802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9bfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9bf3 expref: 23 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951370.998934:0:25802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e037d2b3a00/0x7645c8e1169f9c94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9c8d expref: 23 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951370.998944:0:25802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0247a66000/0x7645c8e1169f9ee0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb51 expref: 12 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951370.998972:0:25802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9f1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbc1 expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951370.998980:0:25802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e0343608000/0x7645c8e1169f9f50 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951370.999039:0:25802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9f1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbc1 expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951370.999056:0:25802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9f1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbc1 expref: 12 pid: 22771 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951370.999073:0:25802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036aebd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25802:1870607945042176:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951370.999209:0:25802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247a66000/0x7645c8e1169f9ee0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb51 expref: 12 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951370.999218:0:25802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247a66000/0x7645c8e1169f9ee0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb51 expref: 12 pid: 22772 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951370.999227:0:25802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036aebdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25802:1870607945042304:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951370.999258:0:25802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e037d2b3a00/0x7645c8e1169f9c94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f9c8d expref: 23 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951370.999266:0:25802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e037d2b3a00/0x7645c8e1169f9c94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f9c8d expref: 23 pid: 22771 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951370.999276:0:25802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036aebca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25802:1870607945042432:0@lo:104: 00000100:00100000:3.0:1783951370.999313:0:25802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783951370.999375:0:25802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9bfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f9bf3 expref: 23 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951370.999385:0:25802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9bfa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f9bf3 expref: 23 pid: 22771 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951370.999393:0:25802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036aebce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25802:1870607945042560:0@lo:104: 00000100:00100000:3.0:1783951370.999412:0:25802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783951370.999432:0:25802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f9bbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f9bb4 expref: 23 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951370.999440:0:25802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f9bbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f9bb4 expref: 23 pid: 22772 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951370.999448:0:25802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036aebd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25802:1870607945042688:0@lo:104: 00000100:00100000:3.0:1783951370.999467:0:25802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783951370.999483:0:25802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0247949600/0x7645c8e1169f9bad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7645c8e1169f9ba6 expref: 23 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951370.999491:0:25802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0247949600/0x7645c8e1169f9bad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7645c8e1169f9ba6 expref: 23 pid: 22772 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951370.999499:0:25802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036aebf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25802:1870607945042816:0@lo:104: 00000100:00100000:3.0:1783951370.999516:0:25802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951370.999526:0:25802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037cb1b840 going to sleep for 11 seconds 00000100:00100000:0.0:1783951370.999646:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945042432 00000100:00100000:0.0:1783951370.999653:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945042432 00000100:00100000:0.0:1783951370.999693:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945042560 00000100:00100000:0.0:1783951370.999696:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945042560 00000100:00100000:0.0:1783951370.999705:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945042688 00000100:00100000:0.0:1783951370.999707:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945042688 00000100:00100000:0.0:1783951370.999716:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945042816 00000100:00100000:0.0:1783951370.999718:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945042816 00000100:00100000:0.0:1783951370.999730:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783951370.999739:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aebd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b1b2cfa-7097-4258-904b-0084ac551497+6:25802:x1870607945042432:12345-0@lo:104: 00010000:00010000:0.0:1783951370.999751:0:22761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2200/0x7645c8e1169f9c8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9c94 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951370.999812:0:22761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783951370.999819:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aebd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b1b2cfa-7097-4258-904b-0084ac551497+6:25802:x1870607945042432:12345-0@lo:104: Request processed in 81us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951370.999826:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783951370.999843:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951370.999849:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b1b2cfa-7097-4258-904b-0084ac551497+5:25802:x1870607945042560:12345-0@lo:104: 00010000:00010000:0.0:1783951370.999856:0:22761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f9bf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9bfa expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951370.999885:0:22761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783951370.999891:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b1b2cfa-7097-4258-904b-0084ac551497+5:25802:x1870607945042560:12345-0@lo:104: Request processed in 43us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951370.999896:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951370.999908:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783951370.999913:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b1b2cfa-7097-4258-904b-0084ac551497+4:25802:x1870607945042688:12345-0@lo:104: 00010000:00010000:0.0:1783951370.999932:0:22761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e03427e8200/0x7645c8e1169f9bb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9bbb expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951370.999974:0:22761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783951370.999979:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b1b2cfa-7097-4258-904b-0084ac551497+4:25802:x1870607945042688:12345-0@lo:104: Request processed in 67us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951370.999986:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783951370.999999:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783951371.000024:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aebf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b1b2cfa-7097-4258-904b-0084ac551497+3:25802:x1870607945042816:12345-0@lo:104: 00010000:00010000:0.0:1783951371.000031:0:22761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9e03427e8400/0x7645c8e1169f9ba6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9bad expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000057:0:22761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783951371.000062:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aebf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b1b2cfa-7097-4258-904b-0084ac551497+3:25802:x1870607945042816:12345-0@lo:104: Request processed in 41us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951371.000068:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1783951371.000088:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783951371.000094:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2200/0x7645c8e1169f9c8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9c94 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000103:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2200 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1783951371.000108:0:22766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2200/0x7645c8e1169f9c8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f9c94 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000117:0:22766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2200/0x7645c8e1169f9c8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f9c94 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951371.000126:0:22766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2200/0x7645c8e1169f9c8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f9c94 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951371.000138:0:22766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783951371.000194:0:22766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2200/0x7645c8e1169f9c8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9c94 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000200:0:22766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783951371.000221:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2200/0x7645c8e1169f9c8d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9c94 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000228:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2200/0x7645c8e1169f9c8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9c94 expref: -99 pid: 25096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000242:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783951371.000245:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f9bf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9bfa expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000250:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2a00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1783951371.000253:0:22766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f9bf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f9bfa expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000259:0:22766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f9bf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f9bfa expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951371.000264:0:22766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f9bf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f9bfa expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951371.000269:0:22766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783951371.000281:0:22766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f9bf3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9bfa expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000287:0:22766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783951371.000307:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f9bf3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9bfa expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000314:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2a00/0x7645c8e1169f9bf3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9bfa expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000323:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783951371.000326:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e03427e8200/0x7645c8e1169f9bb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9bbb expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000331:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e8200 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1783951371.000334:0:22766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e03427e8200/0x7645c8e1169f9bb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f9bbb expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000340:0:22766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e03427e8200/0x7645c8e1169f9bb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f9bbb expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951371.000346:0:22766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e03427e8200/0x7645c8e1169f9bb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f9bbb expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951371.000351:0:22766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783951371.000363:0:22766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e03427e8200/0x7645c8e1169f9bb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9bbb expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000368:0:22766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783951371.000374:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e03427e8200/0x7645c8e1169f9bb4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9bbb expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000379:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e03427e8200/0x7645c8e1169f9bb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9bbb expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000399:0:22766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951371.000403:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9e03427e8400/0x7645c8e1169f9ba6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7645c8e1169f9bad expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000408:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e03427e8400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1783951371.000411:0:22766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9e03427e8400/0x7645c8e1169f9ba6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7645c8e1169f9bad expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000419:0:22766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9e03427e8400/0x7645c8e1169f9ba6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7645c8e1169f9bad expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951371.000425:0:22766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9e03427e8400/0x7645c8e1169f9ba6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7645c8e1169f9bad expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951371.000430:0:22766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783951371.000442:0:22766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9e03427e8400/0x7645c8e1169f9ba6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9bad expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000448:0:22766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783951371.000453:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9e03427e8400/0x7645c8e1169f9ba6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9bad expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000459:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9e03427e8400/0x7645c8e1169f9ba6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7645c8e1169f9bad expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000472:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951371.000474:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951371.000475:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951371.000482:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951371.000507:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0341219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b1b2cfa-7097-4258-904b-0084ac551497:3653:1870607945042944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951371.000537:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951371.000562:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783951371.000568:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e034121b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b1b2cfa-7097-4258-904b-0084ac551497:3653:1870607945043328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951371.000587:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951371.000613:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e034121b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b1b2cfa-7097-4258-904b-0084ac551497:3654:1870607945043072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951371.000634:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951371.000651:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951371.000656:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0341219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b1b2cfa-7097-4258-904b-0084ac551497:3654:1870607945043200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951371.000677:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951371.000702:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945042944 00000100:00100000:0.0:1783951371.000708:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945042944 00010000:00010000:0.0:1783951371.000729:0:22764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e037d2b3a00/0x7645c8e1169f9c94 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9c8d expref: 24 pid: 22771 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951371.000744:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945043328 00000100:00100000:0.0:1783951371.000747:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945043328 00010000:00010000:0.0:1783951371.000756:0:22764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247949600/0x7645c8e1169f9bad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9ba6 expref: 25 pid: 22772 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951371.000768:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945043072 00000100:00100000:0.0:1783951371.000770:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945043072 00010000:00010000:0.0:1783951371.000780:0:22764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9bfa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9bf3 expref: 26 pid: 22771 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951371.000789:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945043200 00000100:00100000:0.0:1783951371.000791:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945043200 00010000:00010000:0.0:1783951371.000800:0:22764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f9bbb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9bb4 expref: 27 pid: 22772 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951371.000827:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783951371.000833:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b1b2cfa-7097-4258-904b-0084ac551497+27:3653:x1870607945042944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951371.000844:0:22764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951371.000852:0:22764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e037d2b3a00/0x7645c8e1169f9c94 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9c8d expref: 27 pid: 22771 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000861:0:22764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e037d2b3a00/0x7645c8e1169f9c94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f9c8d expref: 27 pid: 22771 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000877:0:22764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951371.000906:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b1b2cfa-7097-4258-904b-0084ac551497+27:3653:x1870607945042944:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951371.000913:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783951371.000929:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951371.000935:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b1b2cfa-7097-4258-904b-0084ac551497+26:3653:x1870607945043328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951371.000942:0:22764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951371.000946:0:22764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247949600/0x7645c8e1169f9bad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9ba6 expref: 26 pid: 22772 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000954:0:22764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247949600/0x7645c8e1169f9bad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f9ba6 expref: 26 pid: 22772 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.000964:0:22764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951371.000987:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b1b2cfa-7097-4258-904b-0084ac551497+26:3653:x1870607945043328:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951371.000992:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951371.001019:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783951371.001033:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b1b2cfa-7097-4258-904b-0084ac551497+25:3654:x1870607945043072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951371.001040:0:22764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951371.001044:0:22764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9bfa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9bf3 expref: 25 pid: 22771 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.001052:0:22764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9bfa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f9bf3 expref: 25 pid: 22771 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.001061:0:22764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951371.001087:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b1b2cfa-7097-4258-904b-0084ac551497+25:3654:x1870607945043072:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951371.001092:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783951371.001105:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783951371.001111:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e427480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b1b2cfa-7097-4258-904b-0084ac551497+24:3654:x1870607945043200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951371.001118:0:22764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951371.001122:0:22764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f9bbb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7645c8e1169f9bb4 expref: 24 pid: 22772 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.001129:0:22764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f9bbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7645c8e1169f9bb4 expref: 24 pid: 22772 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.001138:0:22764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951371.001182:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e427480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b1b2cfa-7097-4258-904b-0084ac551497+24:3654:x1870607945043200:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951371.001188:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783951371.001228:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0341219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b1b2cfa-7097-4258-904b-0084ac551497:3654:1870607945043200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951371.001237:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e034121b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b1b2cfa-7097-4258-904b-0084ac551497:3654:1870607945043072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951371.001263:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e034121b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b1b2cfa-7097-4258-904b-0084ac551497:3653:1870607945043328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951371.001280:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0341219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b1b2cfa-7097-4258-904b-0084ac551497:3653:1870607945042944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951371.006638:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e037d2b3a00/0x7645c8e1169f9c94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f9c8d expref: 23 pid: 22771 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951371.006660:0:25802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036aebca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25802:1870607945042432:0@lo:104: 00010000:00010000:3.0:1783951371.008221:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247949a00/0x7645c8e1169f9bfa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f9bf3 expref: 22 pid: 22771 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951371.008251:0:25802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036aebce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25802:1870607945042560:0@lo:104: 00010000:00010000:3.0:1783951371.008288:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247948c00/0x7645c8e1169f9bbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f9bb4 expref: 21 pid: 22772 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951371.008297:0:25802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036aebd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25802:1870607945042688:0@lo:104: 00010000:00010000:3.0:1783951371.008305:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247949600/0x7645c8e1169f9bad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7645c8e1169f9ba6 expref: 20 pid: 22772 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951371.008313:0:25802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036aebf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25802:1870607945042816:0@lo:104: 00000100:00100000:2.0:1783951371.013981:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951371.014090:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951371.014197:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923962624 00000100:00100000:1.0:1783951371.014206:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923962624 00010000:00010000:1.0:1783951371.014247:0:22762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9f1f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbc1 expref: 13 pid: 22771 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951371.014280:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923962752 00000100:00100000:1.0:1783951371.014283:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923962752 00010000:00010000:1.0:1783951371.014295:0:22762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0247a66000/0x7645c8e1169f9ee0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb51 expref: 14 pid: 22772 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951371.014314:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:1.0:1783951371.014323:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036c662c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:705f0753-e3a3-473c-9c20-46e2ee691cf8+14:2408:x1870607923962624:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951371.014337:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951371.014342:0:22762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9f1f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbc1 expref: 14 pid: 22771 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951371.014368:0:22762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9f1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbc1 expref: 14 pid: 22771 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951371.014388:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951371.014435:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036c662c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:705f0753-e3a3-473c-9c20-46e2ee691cf8+14:2408:x1870607923962624:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 114us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951371.014444:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:1.0:1783951371.014491:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00100000:1.0:1783951371.014498:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:2407:x1870607923962752:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951371.014508:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951371.014512:0:22762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0247a66000/0x7645c8e1169f9ee0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb51 expref: 13 pid: 22772 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951371.014521:0:22762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0247a66000/0x7645c8e1169f9ee0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb51 expref: 13 pid: 22772 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951371.014532:0:22762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e0343608000/0x7645c8e1169f9f50 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951371.014540:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0343608000/0x7645c8e1169f9f50 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951371.014555:0:22762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0343608000/0x7645c8e1169f9f50 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951371.014563:0:22762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0343608000/0x7645c8e1169f9f50 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951371.014569:0:22762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e0343608000/0x7645c8e1169f9f50 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951371.014581:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e0343608000/0x7645c8e1169f9f50 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951371.014587:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608000 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951371.014591:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e0343608000/0x7645c8e1169f9f50 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951371.014598:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e0343608000/0x7645c8e1169f9f50 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951371.014606:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e0343608000/0x7645c8e1169f9f50 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951371.014615:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951371.014635:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:2407:x1870607923962752:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 138us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951371.014642:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 14 00010000:00010000:3.0:1783951371.015627:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0343608200/0x7645c8e1169f9f1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbc1 expref: 12 pid: 22771 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951371.015645:0:25802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036aebd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25802:1870607945042176:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783951371.015823:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0247a66000/0x7645c8e1169f9ee0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb51 expref: 11 pid: 22772 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951371.015834:0:25802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036aebdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25802:1870607945042304:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783951371.015931:0:25802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e0343608000/0x7645c8e1169f9f50 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951371.015942:0:25802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e0343608000/0x7645c8e1169f9f50 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951371.015948:0:25802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e0343608000/0x7645c8e1169f9f50 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951371.015956:0:25802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0343608000/0x7645c8e1169f9f50 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951371.810885:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951371.873296:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951371.877612:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945043456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951371.877734:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951371.877962:0:24285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945043456 00000100:00100000:1.0:1783951371.878107:0:24285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945043456 00000100:00100000:1.0:1783951371.878313:0:24285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783951371.878326:0:24285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945043456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783951371.878363:0:24285:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783951371.878422:0:24285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945043456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951371.878430:0:24285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783951371.878541:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945043456:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783951371.878739:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783951372.833858:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951372.856747:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951372.856942:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923962880 00000100:00100000:0.0:1783951372.856951:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923962880 00000100:00100000:0.0:1783951372.857042:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:0.0:1783951372.857053:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:18734:x1870607923962880:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783951372.857074:0:22776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951372.857094:0:22776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f9f57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fbf9 expref: -99 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857203:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9f5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857219:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9f5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857232:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9f5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857247:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3600/0x7645c8e1169f9f65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857256:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3600/0x7645c8e1169f9f65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857262:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3600/0x7645c8e1169f9f65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857364:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2000/0x7645c8e1169f9f6c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857373:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2000/0x7645c8e1169f9f6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857380:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2000/0x7645c8e1169f9f6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951372.857412:0:22776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783951372.857416:0:22776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783951372.857451:0:22776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2000/0x7645c8e1169f9f6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857462:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9f5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857470:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9f5e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857477:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9f5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857484:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951372.857488:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9f5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857496:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9f5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857508:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e024109bc00) 00010000:00010000:0.0:1783951372.857517:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951372.857522:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9f5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857528:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9f5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857543:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3600/0x7645c8e1169f9f65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857549:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3600/0x7645c8e1169f9f65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857555:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3600/0x7645c8e1169f9f65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857561:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b3600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951372.857564:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3600/0x7645c8e1169f9f65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857570:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3600/0x7645c8e1169f9f65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857577:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e0247832500) 00010000:00010000:0.0:1783951372.857579:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951372.857582:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3600/0x7645c8e1169f9f65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857588:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3600/0x7645c8e1169f9f65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857616:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169f9f57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbf9 expref: 8 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857641:0:22776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2000/0x7645c8e1169f9f6c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbf9 expref: 7 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.857649:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e0247832600) 00010000:00010000:0.0:1783951372.857651:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783951372.857653:0:22776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2000, rc 0) 00000100:00100000:0.0:1783951372.857720:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+7:18734:x1870607923962880:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 669us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951372.857728:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00080000:2.0:1783951372.857850:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951372.871571:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951372.871686:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923963008 00000100:00100000:0.0:1783951372.871696:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923963008 00000100:00100000:0.0:1783951372.871806:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:0.0:1783951372.871819:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+7:18734:x1870607923963008:12345-192.168.202.33@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1783951372.871923:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+7:18734:x1870607923963008:12345-192.168.202.33@tcp:900:lhsmtool_posix.0 Request processed in 106us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951372.871931:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:3.0:1783951372.874553:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951372.875002:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923963264 00000100:00100000:1.0:1783951372.875011:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923963264 00000100:00100000:1.0:1783951372.875081:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 24 00000100:00100000:1.0:1783951372.875106:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+7:18734:x1870607923963264:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951372.875127:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951372.875387:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66e00/0x7645c8e1169f9f73 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc00 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.875464:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f9f7a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.875479:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f9f7a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.875492:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f9f7a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.875508:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169f9f81 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.875515:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169f9f81 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.875521:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169f9f81 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.875649:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f9f88 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.875658:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f9f88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.875665:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f9f88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951372.875687:0:22778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1783951372.876289:0:22778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f9f7a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.876299:0:22778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f9f7a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.876306:0:22778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f9f7a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.876312:0:22778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951372.876316:0:22778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f9f7a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.876325:0:22778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f9f7a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.876339:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e0247832600) 00010000:00010000:1.0:1783951372.876342:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951372.876347:0:22778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f9f7a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.876353:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66600/0x7645c8e1169f9f7a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.876366:0:22778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169f9f81 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.876373:0:22778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169f9f81 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.876391:0:22778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169f9f81 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.876396:0:22778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951372.876400:0:22778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169f9f81 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.876407:0:22778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169f9f81 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.876415:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e0347f05300) 00010000:00010000:1.0:1783951372.876418:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951372.876421:0:22778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169f9f81 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.876426:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169f9f81 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.878318:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66e00/0x7645c8e1169f9f73 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc00 expref: 10 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.878346:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67a00/0x7645c8e1169f9f88 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc00 expref: 9 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.878355:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e0347f05600) 00010000:00010000:1.0:1783951372.878357:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951372.878360:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67a00, rc 0) 00000100:00100000:1.0:1783951372.878467:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+9:18734:x1870607923963264:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 3364us (3923us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1783951372.878492:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 24 00000100:00100000:2.0:1783951372.886108:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951372.888925:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923963392 00000100:00100000:1.0:1783951372.888942:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923963392 00000100:00100000:1.0:1783951372.891407:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:1.0:1783951372.891420:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+9:18734:x1870607923963392:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1783951372.891531:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+9:18734:x1870607923963392:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 Request processed in 113us (5433us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951372.891539:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:0.0:1783951372.897002:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951372.897027:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607945043584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951372.897095:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951372.897202:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945043584 00000100:00100000:0.0:1783951372.897210:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945043584 00000100:00100000:0.0:1783951372.897256:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783951372.897264:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607945043584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783951372.897299:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783951372.897348:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1870607945043584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951372.897366:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783951372.897408:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3655:1870607945043584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951372.898168:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945043712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951372.898202:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951372.898279:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945043712 00000100:00100000:1.0:1783951372.898285:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945043712 00000100:00100000:1.0:1783951372.898310:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783951372.898318:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607945043712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783951372.898339:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783951372.898388:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607945043712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951372.898394:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783951372.898461:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945043712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951372.909939:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951372.911332:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923963520 00000100:00100000:1.0:1783951372.911346:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923963520 00000100:00100000:1.0:1783951372.911423:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 26 00000100:00100000:1.0:1783951372.911436:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+5:18734:x1870607923963520:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1783951372.912009:0:22778:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 528us 00000100:00080000:2.0:1783951372.916092:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951372.932251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951372.932343:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923963648 00000100:00100000:1.0:1783951372.932353:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923963648 00000100:00100000:1.0:1783951372.932452:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 145 00000100:00100000:1.0:1783951372.932463:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+11:18116:x1870607923963648:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951372.932494:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951372.932514:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f9f96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc07 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.932543:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f9f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc07 expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.932553:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a66e00/0x7645c8e1169f9f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc07 expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.932562:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66e00, rc 0) 00000100:00100000:1.0:1783951372.932616:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+12:18116:x1870607923963648:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 Request processed in 154us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951372.932623:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 145 00000100:00100000:3.0:1783951372.936051:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951372.937272:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+5:18734:x1870607923963520:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 Request processed in 25833us (27348us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951372.937285:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 26 00000100:00100000:2.0:1783951372.942971:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923963776 00000100:00100000:2.0:1783951372.942998:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923963776 00000100:00100000:2.0:1783951372.943069:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 146 00000100:00100000:2.0:1783951372.943079:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+12:18116:x1870607923963776:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951372.943264:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+12:18116:x1870607923963776:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 Request processed in 185us (7221us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951372.943273:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 146 00000100:00100000:3.0:1783951372.955257:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951372.955321:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923963904 00000100:00100000:0.0:1783951372.955331:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923963904 00000100:00100000:0.0:1783951372.955380:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 147 00000100:00100000:0.0:1783951372.955392:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0241ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+12:18116:x1870607923963904:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951372.955555:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0241ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+12:18116:x1870607923963904:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 Request processed in 165us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951372.955563:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 147 00000100:00100000:2.0:1783951372.959460:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951372.959503:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951372.959698:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923964032 00000100:00100000:0.0:1783951372.959708:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923964032 00000100:00100000:3.0:1783951372.959873:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923964160 00000100:00100000:3.0:1783951372.959878:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923964160 00000100:00100000:3.0:1783951372.959917:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 148 00000100:00100000:3.0:1783951372.959927:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+12:18116:x1870607923964160:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951372.959939:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 27 00010000:00010000:3.0:1783951372.959945:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1783951372.959952:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+9:18740:x1870607923964032:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951372.959964:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0343609800/0x7645c8e1169f9f9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc15 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.959965:0:22776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951372.959980:0:22776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3600/0x7645c8e1169f9fa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc0e expref: -99 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951372.960015:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0343609800/0x7645c8e1169f9f9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc15 expref: 13 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951372.960027:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0343609800/0x7645c8e1169f9f9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc15 expref: 13 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951372.960037:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609800, rc 0) 00010000:00010000:0.0:1783951372.960051:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9fab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.960064:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9fab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.960082:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9fab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951372.960088:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:18116:x1870607923964160:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 Request processed in 161us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951372.960097:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 148 00000040:00080000:3.0:1783951372.962711:0:23527:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783951372.963386:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f9fb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.963404:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f9fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.963417:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f9fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.963467:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9fab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.963474:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9fab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.963481:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9fab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.963487:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951372.963491:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9fab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.963498:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9fab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.963510:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e024109bc00) 00010000:00010000:0.0:1783951372.963513:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951372.963518:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9fab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.963539:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169f9fab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.963553:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f9fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.963558:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f9fb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.963564:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f9fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.963568:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951372.963571:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f9fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.963577:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f9fb2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.963585:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e0247832500) 00010000:00010000:0.0:1783951372.963588:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951372.963590:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f9fb2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.963596:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2600/0x7645c8e1169f9fb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.963643:0:22776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3600/0x7645c8e1169f9fa4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc0e expref: 10 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.963668:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e024109bc00) 00010000:00010000:0.0:1783951372.963671:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951372.963675:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3600/0x7645c8e1169f9fa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc0e expref: 10 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951372.963686:0:22776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3600, rc 0) 00000100:00100000:0.0:1783951372.964037:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+9:18740:x1870607923964032:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 4086us (4584us total) trans 0 rc 301/301 00000100:00100000:0.0:1783951372.964048:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 27 00000100:00100000:3.0:1783951372.964278:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951372.964338:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923964288 00000100:00100000:1.0:1783951372.964347:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923964288 00000100:00100000:1.0:1783951372.964389:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 149 00000100:00100000:1.0:1783951372.964399:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:18116:x1870607923964288:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951372.969606:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:18116:x1870607923964288:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 Request processed in 5195us (5316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951372.969625:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 149 00000100:00100000:2.0:1783951372.971013:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951372.971438:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923964416 00000100:00100000:2.0:1783951372.971447:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923964416 00000100:00100000:2.0:1783951372.971504:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:2.0:1783951372.971515:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+9:18740:x1870607923964416:12345-192.168.202.33@tcp:700:lfs.0 00000100:00100000:2.0:1783951372.974248:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+9:18740:x1870607923964416:12345-192.168.202.33@tcp:700:lfs.0 Request processed in 2723us (3228us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951372.974527:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:2.0:1783951372.976090:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951372.976250:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923964544 00000100:00100000:1.0:1783951372.976260:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923964544 00000100:00100000:1.0:1783951372.976314:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 150 00000100:00100000:1.0:1783951372.976326:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:18116:x1870607923964544:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951372.976482:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:18116:x1870607923964544:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 Request processed in 158us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951372.976497:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 150 00000100:00100000:2.0:1783951372.980670:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951372.980751:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923964800 00000100:00100000:3.0:1783951372.980761:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923964800 00000100:00100000:3.0:1783951372.980887:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 28 00000100:00100000:3.0:1783951372.980899:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e024860e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+9:18740:x1870607923964800:12345-192.168.202.33@tcp:36:lfs.0 00010000:00010000:3.0:1783951372.980958:0:22778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951372.980997:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f9f0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fb82 expref: 9 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951372.981021:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e024109bc00) 00010000:00010000:3.0:1783951372.981028:0:22778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951372.981087:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f9fb9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951372.981100:0:22778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169f9f49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbf2 expref: 5 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951372.981129:0:22778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f9fb9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951372.981203:0:22778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169f9f49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbf2 expref: 5 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951372.981214:0:22778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169f9f49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbf2 expref: 5 pid: 22776 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951372.981226:0:22778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036aebd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22778:1870607945043840:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951372.981338:0:22778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037cb1b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951372.993606:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951372.993706:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923964928 00000100:00100000:1.0:1783951372.993717:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923964928 00010000:00010000:1.0:1783951372.993785:0:22762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169f9f49 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbf2 expref: 6 pid: 22776 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951372.993836:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00100000:1.0:1783951372.993845:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ee916a-a3ac-448f-ada8-d39e07682174+6:2407:x1870607923964928:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951372.993861:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951372.993868:0:22762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169f9f49 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbf2 expref: 6 pid: 22776 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.993882:0:22762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169f9f49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbf2 expref: 6 pid: 22776 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.993906:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e024109bc00) 00010000:00010000:1.0:1783951372.993912:0:22762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f9fb9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.993922:0:22762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f9fb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.993930:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f9fb9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951372.993948:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951372.994018:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62ee916a-a3ac-448f-ada8-d39e07682174+6:2407:x1870607923964928:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 173us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951372.994045:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00080000:2.0:1783951372.994236:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783951372.994474:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169f9f49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fbf2 expref: 5 pid: 22776 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951372.994492:0:22778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036aebd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22778:1870607945043840:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951372.994514:0:22778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f9fb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951372.994523:0:22778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f9fb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951372.994530:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f9fb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951372.994552:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f9fc0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951372.994561:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f9fc0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951372.994578:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f9fc0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951372.996097:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9000/0x7645c8e1169f9fc7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951372.996113:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9000/0x7645c8e1169f9fc7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951372.996122:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9000/0x7645c8e1169f9fc7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951372.996168:0:22778:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cf339f51 reply state 00000000c024ccaf transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9000/0x7645c8e1169f9fc7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951372.996180:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9000/0x7645c8e1169f9fc7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951372.996188:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e03427e5700) 00010000:00010000:2.0:1783951372.996191:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783951372.996195:0:22778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783951372.996201:0:22778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783951372.996209:0:22778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f9fb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951372.996215:0:22778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f9fb9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951372.996222:0:22778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f9fb9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951372.996234:0:22778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608c00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951372.996238:0:22778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f9fb9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951372.996245:0:22778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f9fb9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951372.996256:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e024109bc00) 00010000:00010000:2.0:1783951372.996258:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951372.996261:0:22778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f9fb9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951372.996266:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608c00/0x7645c8e1169f9fb9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951372.996282:0:22778:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cf339f51 reply state 00000000c024ccaf transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f9fc0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951372.996289:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f9fc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951372.996294:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e024109d400) 00010000:00010000:2.0:1783951372.996296:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783951372.996298:0:22778:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1783951372.996375:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e024860e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+10:18740:x1870607923964800:12345-192.168.202.33@tcp:36:lfs.0 Request processed in 15475us (15715us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1783951372.996382:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 28 10000000:01000000:0.0:1783951373.024301:0:22774:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783951373.024310:0:22774:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0247afd000 from 13 10000000:01000000:0.0:1783951373.024316:0:22774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783951373.024372:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3600/0x7645c8e1169f9fce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.024384:0:22774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3600/0x7645c8e1169f9fce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.024395:0:22774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3600/0x7645c8e1169f9fce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951373.024422:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0341219880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945043968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951373.024512:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951373.024572:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e024778d540 going to sleep for 11 seconds 00000100:00100000:1.0:1783951373.025188:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945043968 00000100:00100000:1.0:1783951373.025198:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945043968 00000100:00100000:1.0:1783951373.025256:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783951373.025266:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+20:22774:x1870607945043968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951373.025280:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951373.025294:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0247a66600/0x7645c8e1169f9fd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9fce expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.025318:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0247a66600/0x7645c8e1169f9fd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9fce expref: 21 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.025328:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0247a66600/0x7645c8e1169f9fd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9fce expref: 21 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.025336:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66600, rc 0) 00000100:00100000:1.0:1783951373.025398:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+21:22774:x1870607945043968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951373.025405:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783951373.025519:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0341219880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945043968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951373.025536:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3600/0x7645c8e1169f9fce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9fd5 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.025559:0:22774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3600/0x7645c8e1169f9fce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9fd5 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951373.025626:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945044096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951373.025655:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951373.025687:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246ad4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951373.025924:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945044096 00000100:00100000:1.0:1783951373.025929:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945044096 00000100:00100000:1.0:1783951373.025961:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783951373.025968:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+21:22774:x1870607945044096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951373.026126:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+21:22774:x1870607945044096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951373.026134:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783951373.026342:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945044096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951373.026380:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036aebd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945044224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951373.026427:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951373.026483:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037cb1b480 going to sleep for 11 seconds 00000100:00100000:2.0:1783951373.026546:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945044224 00000100:00100000:2.0:1783951373.026551:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945044224 00000100:00100000:2.0:1783951373.026571:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783951373.026577:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+21:22774:x1870607945044224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951373.026663:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+21:22774:x1870607945044224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951373.026670:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783951373.026805:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036aebd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945044224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783951373.028431:0:25817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1783951373.028760:0:22774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1783951373.028796:0:22774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951373.028807:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3600/0x7645c8e1169f9fce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9fd5 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.028821:0:22774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b3600/0x7645c8e1169f9fce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9fd5 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951373.028839:0:22774:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783951373.028841:0:22774:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e036b543000 from 13 10000000:01000000:3.0:1783951373.028844:0:22774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951373.028875:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343608200/0x7645c8e1169f9fdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.028882:0:22774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0343608200/0x7645c8e1169f9fdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.028892:0:22774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0343608200/0x7645c8e1169f9fdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951373.028924:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036aebd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945044352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951373.028975:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951373.029030:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037cb1b480 going to sleep for 11 seconds 00000100:00100000:2.0:1783951373.029231:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945044352 00000100:00100000:2.0:1783951373.029238:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945044352 00000100:00100000:2.0:1783951373.029318:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783951373.029326:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+21:22774:x1870607945044352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951373.029339:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951373.029351:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e036b4a9200/0x7645c8e1169f9fe3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9fdc expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.029375:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e036b4a9200/0x7645c8e1169f9fe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9fdc expref: 22 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.029386:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e036b4a9200/0x7645c8e1169f9fe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9fdc expref: 22 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.029405:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e036b4a9200, rc 0) 00000100:00100000:2.0:1783951373.029447:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+22:22774:x1870607945044352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951373.029454:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783951373.029533:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036aebd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945044352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951373.029545:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0343608200/0x7645c8e1169f9fdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9fe3 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.029554:0:22774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0343608200/0x7645c8e1169f9fdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9fe3 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951373.029603:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036aebd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945044480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951373.029625:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951373.029847:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037cb1b480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951373.030001:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945044480 00000100:00100000:0.0:1783951373.030006:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945044480 00000100:00100000:0.0:1783951373.030029:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783951373.030035:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+22:22774:x1870607945044480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951373.030188:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+22:22774:x1870607945044480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951373.030195:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783951373.030273:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036aebd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945044480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951373.030300:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036aebd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945044608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951373.030334:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951373.030362:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037cb1b480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951373.030405:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945044608 00000100:00100000:0.0:1783951373.030409:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945044608 00000100:00100000:0.0:1783951373.030424:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783951373.030429:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+22:22774:x1870607945044608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951373.030512:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+22:22774:x1870607945044608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951373.030519:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783951373.030641:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036aebd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945044608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783951373.031604:0:25818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1783951373.032050:0:22774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1783951373.032074:0:22774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783951373.032085:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343608200/0x7645c8e1169f9fdc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9fe3 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.032098:0:22774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0343608200/0x7645c8e1169f9fdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9fe3 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951373.032110:0:22774:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783951373.032113:0:22774:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e0377b14000 from 13 10000000:01000000:0.0:1783951373.032116:0:22774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783951373.032183:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f9fea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.032193:0:22774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f9fea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.032202:0:22774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f9fea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951373.032240:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e034121b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945044736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951373.032296:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951373.032341:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246b6a780 going to sleep for 11 seconds 00000100:00100000:3.0:1783951373.032574:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945044736 00000100:00100000:3.0:1783951373.032581:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945044736 00000100:00100000:3.0:1783951373.032616:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783951373.032625:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+22:22774:x1870607945044736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951373.032638:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951373.032658:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0343608c00/0x7645c8e1169f9ff1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9fea expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.032685:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0343608c00/0x7645c8e1169f9ff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9fea expref: 23 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.032697:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0343608c00/0x7645c8e1169f9ff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9fea expref: 23 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.032706:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608c00, rc 0) 00000100:00100000:3.0:1783951373.032768:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+23:22774:x1870607945044736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951373.032880:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e034121b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945044736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951373.032895:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f9fea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9ff1 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.032904:0:22774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f9fea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9ff1 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951373.032961:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e034121b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945044864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951373.033000:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951373.033017:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246b6a780 going to sleep for 11 seconds 00000100:00100000:3.0:1783951373.033186:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783951373.033213:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945044864 00000100:00100000:3.0:1783951373.033217:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945044864 00000100:00100000:3.0:1783951373.033231:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783951373.033237:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+23:22774:x1870607945044864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951373.033345:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+23:22774:x1870607945044864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951373.033353:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783951373.034059:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e034121b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945044864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951373.034114:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e034121b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945044992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951373.034202:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951373.034236:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246b6a780 going to sleep for 11 seconds 00000100:00100000:3.0:1783951373.034507:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945044992 00000100:00100000:3.0:1783951373.034513:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945044992 00000100:00100000:3.0:1783951373.034543:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783951373.034551:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+23:22774:x1870607945044992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951373.034655:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+23:22774:x1870607945044992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951373.034662:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783951373.034814:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e034121b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945044992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783951373.036137:0:25819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1783951373.036372:0:22774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1783951373.036404:0:22774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951373.036415:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f9fea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9ff1 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.036426:0:22774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e037d2b2600/0x7645c8e1169f9fea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9ff1 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951373.036437:0:22774:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783951373.036439:0:22774:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e037ca6d800 from 13 10000000:01000000:3.0:1783951373.036442:0:22774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951373.036489:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343608000/0x7645c8e1169f9ff8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.036498:0:22774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9e0343608000/0x7645c8e1169f9ff8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.036508:0:22774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9e0343608000/0x7645c8e1169f9ff8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951373.036531:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036aebd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945045120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951373.036582:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951373.036628:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037cb1be40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951373.036750:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945045120 00000100:00100000:2.0:1783951373.036757:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945045120 00000100:00100000:2.0:1783951373.036812:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783951373.036821:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+23:22774:x1870607945045120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951373.036844:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951373.036858:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e036b4a8200/0x7645c8e1169f9fff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7645c8e1169f9ff8 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.036882:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e036b4a8200/0x7645c8e1169f9fff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7645c8e1169f9ff8 expref: 24 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.036892:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e036b4a8200/0x7645c8e1169f9fff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7645c8e1169f9ff8 expref: 24 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.036900:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e036b4a8200, rc 0) 00000100:00100000:2.0:1783951373.036938:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b1b2cfa-7097-4258-904b-0084ac551497+24:22774:x1870607945045120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951373.036946:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783951373.037258:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036aebd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945045120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951373.037274:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9e0343608000/0x7645c8e1169f9ff8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9fff expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.037283:0:22774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9e0343608000/0x7645c8e1169f9ff8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7645c8e1169f9fff expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951373.037343:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036aebd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945045248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951373.037382:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951373.037404:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037cb1be40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951373.037420:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945045248 00000100:00100000:3.0:1783951373.037424:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945045248 00000100:00100000:3.0:1783951373.037445:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783951373.037451:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+24:22774:x1870607945045248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951373.037571:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+24:22774:x1870607945045248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951373.037578:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783951373.037609:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036aebd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945045248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951373.037635:0:22774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036aebd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945045376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951373.037676:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951373.037691:0:22774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037cb1be40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951373.037703:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945045376 00000100:00100000:3.0:1783951373.037705:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945045376 00000100:00100000:3.0:1783951373.037721:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783951373.037726:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+24:22774:x1870607945045376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951373.037969:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b1b2cfa-7097-4258-904b-0084ac551497+24:22774:x1870607945045376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 241us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951373.037975:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783951373.038022:0:22774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036aebd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b1b2cfa-7097-4258-904b-0084ac551497:22774:1870607945045376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783951373.039395:0:25820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783951373.039963:0:22774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783951373.039998:0:22774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783951373.040009:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9e0343608000/0x7645c8e1169f9ff8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9fff expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.040040:0:22774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9e0343608000/0x7645c8e1169f9ff8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7645c8e1169f9fff expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951373.137327:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951373.137415:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923965056 00000100:00100000:0.0:1783951373.137424:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923965056 00000100:00100000:0.0:1783951373.137481:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:0.0:1783951373.137492:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+10:18750:x1870607923965056:12345-192.168.202.33@tcp:101:lctl.0 00010000:00010000:0.0:1783951373.137519:0:22776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951373.137554:0:22776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169fa006 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc1c expref: -99 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.137624:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169fa00d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.137638:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169fa00d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.137651:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169fa00d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951373.137703:0:22776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783951373.137708:0:22776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783951373.137751:0:22776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169fa00d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.137792:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169fa006 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc1c expref: 12 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.137811:0:22776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3e00/0x7645c8e1169fa00d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc1c expref: 11 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.137820:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247832100) 00010000:00010000:0.0:1783951373.137823:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783951373.137826:0:22776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3e00, rc 0) 00000100:00100000:0.0:1783951373.137891:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+11:18750:x1870607923965056:12345-192.168.202.33@tcp:101:lctl.0 Request processed in 401us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951373.137899:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:3.0:1783951373.178898:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951373.179813:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923965184 00000100:00100000:2.0:1783951373.179824:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923965184 00000100:00100000:2.0:1783951373.179893:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 30 00000100:00100000:2.0:1783951373.179903:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ee916a-a3ac-448f-ada8-d39e07682174+5:18751:x1870607923965184:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:2.0:1783951373.179923:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951373.179944:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8400/0x7645c8e1169fa014 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc23 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.180020:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9600/0x7645c8e1169fa01b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.180034:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9600/0x7645c8e1169fa01b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.180044:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9600/0x7645c8e1169fa01b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951373.180091:0:22778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783951373.180094:0:22778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951373.180113:0:22778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9600/0x7645c8e1169fa01b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.180136:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8400/0x7645c8e1169fa014 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc23 expref: 7 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.180198:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9600/0x7645c8e1169fa01b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc23 expref: 6 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.180206:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247832100) 00010000:00010000:2.0:1783951373.180210:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951373.180213:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e036b4a9600, rc 0) 00000100:00100000:2.0:1783951373.180294:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ee916a-a3ac-448f-ada8-d39e07682174+6:18751:x1870607923965184:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 393us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951373.180302:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 30 00000100:00100000:2.0:1783951373.186282:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951373.186393:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923965312 00000100:00100000:1.0:1783951373.186403:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923965312 00000100:00100000:1.0:1783951373.186461:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 31 00000100:00100000:1.0:1783951373.186471:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ee916a-a3ac-448f-ada8-d39e07682174+6:18751:x1870607923965312:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:1.0:1783951373.186493:0:22777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951373.186514:0:22777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169fa022 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc2a expref: -99 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186583:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa029 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186596:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa029 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186607:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa029 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186619:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa030 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186626:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa030 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186632:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa030 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186715:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa037 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186724:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa037 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186762:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa037 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951373.186806:0:22777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783951373.186811:0:22777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783951373.186835:0:22777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa037 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186849:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa029 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186854:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa029 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186861:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa029 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186867:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67800 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951373.186871:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa029 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186878:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa029 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186891:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247832100) 00010000:00010000:1.0:1783951373.186894:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951373.186898:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa029 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186905:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa029 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186930:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa030 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186937:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa030 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186943:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa030 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186949:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951373.186952:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa030 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186959:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa030 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186967:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e024109d400) 00010000:00010000:1.0:1783951373.186970:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951373.186973:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa030 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.186979:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa030 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.187018:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169fa022 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc2a expref: 8 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.187031:0:22777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa037 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc2a expref: 7 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.187050:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e03427e5700) 00010000:00010000:1.0:1783951373.187052:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951373.187055:0:22777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66a00, rc 0) 00000100:00100000:1.0:1783951373.187211:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ee916a-a3ac-448f-ada8-d39e07682174+7:18751:x1870607923965312:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 740us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951373.187220:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 31 00000100:00100000:3.0:1783951373.196264:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951373.200997:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923965440 00000100:00100000:0.0:1783951373.201033:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923965440 00000100:00100000:0.0:1783951373.201161:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:0.0:1783951373.201174:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:62ee916a-a3ac-448f-ada8-d39e07682174+5:18751:x1870607923965440:12345-192.168.202.33@tcp:900:lfs.0 00000100:00100000:0.0:1783951373.201291:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:62ee916a-a3ac-448f-ada8-d39e07682174+5:18751:x1870607923965440:12345-192.168.202.33@tcp:900:lfs.0 Request processed in 105us (5023us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951373.201299:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00080000:2.0:1783951373.201908:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951373.210923:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951373.211578:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923965696 00000100:00100000:0.0:1783951373.211589:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923965696 00000100:00100000:0.0:1783951373.211656:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 32 00000100:00100000:0.0:1783951373.211667:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee916a-a3ac-448f-ada8-d39e07682174+7:18751:x1870607923965696:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951373.211688:0:22776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951373.211708:0:22776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169fa03e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc31 expref: -99 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951373.211819:0:22776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783951373.211949:0:22776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169fa03e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc31 expref: 9 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.211963:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247832100) 00010000:00010000:0.0:1783951373.211967:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783951373.211972:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169fa03e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc31 expref: 9 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.212203:0:22776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2200, rc 0) 00000100:00100000:0.0:1783951373.212276:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee916a-a3ac-448f-ada8-d39e07682174+8:18751:x1870607923965696:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 609us (1361us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1783951373.212283:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 32 00000100:00100000:1.0:1783951373.228721:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951373.228844:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923965952 00000100:00100000:0.0:1783951373.228855:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923965952 00000100:00100000:0.0:1783951373.228923:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 33 00000100:00100000:0.0:1783951373.228935:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036ae2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ee916a-a3ac-448f-ada8-d39e07682174+8:18751:x1870607923965952:12345-192.168.202.33@tcp:36:lfs.0 00010000:00010000:0.0:1783951373.229006:0:22777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951373.229036:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa037 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc2a expref: 8 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.229067:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e03427e5700) 00010000:00010000:0.0:1783951373.229073:0:22777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951373.229096:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169fa04c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.229109:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169fa04c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.229120:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169fa04c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783951373.229372:0:22777:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003476d49f reply state 000000006748251f transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169fa04c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.229385:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169fa04c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.229392:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e03427e5700) 00010000:00010000:0.0:1783951373.229395:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1783951373.229398:0:22777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783951373.229407:0:22777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1783951373.229503:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036ae2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62ee916a-a3ac-448f-ada8-d39e07682174+9:18751:x1870607923965952:12345-192.168.202.33@tcp:36:lfs.0 Request processed in 569us (791us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1783951373.229525:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 33 00000100:00100000:3.0:1783951373.241877:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951373.242050:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923966208 00000100:00100000:1.0:1783951373.242061:0:22779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923966208 00000100:00100000:1.0:1783951373.242122:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 2 00000100:00100000:1.0:1783951373.242133:0:22779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ee916a-a3ac-448f-ada8-d39e07682174+9:18751:x1870607923966208:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:1.0:1783951373.242792:0:22779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ee916a-a3ac-448f-ada8-d39e07682174+10:18751:x1870607923966208:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 658us (921us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1783951373.242801:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 2 00000100:00100000:3.0:1783951373.246101:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951373.246221:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923966464 00000100:00100000:0.0:1783951373.246231:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923966464 00000100:00100000:0.0:1783951373.246294:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 34 00000100:00100000:0.0:1783951373.246305:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee916a-a3ac-448f-ada8-d39e07682174+10:18751:x1870607923966464:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1783951373.246330:0:22776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951373.246351:0:22776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169fa053 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc38 expref: -99 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246423:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa05a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246438:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa05a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246465:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa05a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246479:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169fa061 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246487:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169fa061 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246495:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169fa061 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951373.246599:0:22776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783951373.246675:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa05a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246699:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa05a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246707:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa05a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246713:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951373.246718:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa05a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246726:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa05a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246738:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247832100) 00010000:00010000:0.0:1783951373.246741:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951373.246745:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa05a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246752:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa05a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246766:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169fa061 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246773:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169fa061 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246779:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169fa061 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246784:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b3a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951373.246793:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169fa061 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246799:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169fa061 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246806:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e024109d400) 00010000:00010000:0.0:1783951373.246809:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951373.246812:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169fa061 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246818:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169fa061 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246860:0:22776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169fa053 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc38 expref: 12 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246871:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247832100) 00010000:00010000:0.0:1783951373.246873:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783951373.246877:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169fa053 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc38 expref: 12 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.246886:0:22776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2e00, rc 0) 00000100:00100000:0.0:1783951373.246946:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee916a-a3ac-448f-ada8-d39e07682174+11:18751:x1870607923966464:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 642us (854us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1783951373.246954:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 34 00000100:00100000:2.0:1783951373.256610:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951373.265336:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923966592 00000100:00100000:1.0:1783951373.265351:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923966592 00000100:00100000:1.0:1783951373.267710:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 35 00000100:00100000:1.0:1783951373.267737:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ee916a-a3ac-448f-ada8-d39e07682174+11:18751:x1870607923966592:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:1.0:1783951373.267765:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951373.267789:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa06f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc3f expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.267910:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa076 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.267924:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa076 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.267951:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa076 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951373.267997:0:22778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783951373.268002:0:22778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783951373.268024:0:22778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa076 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.268063:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa06f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc3f expref: 13 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.268082:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa076 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc3f expref: 12 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.268092:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e03427e5700) 00010000:00010000:1.0:1783951373.268095:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951373.268099:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67800, rc 0) 00000100:00100000:1.0:1783951373.268181:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ee916a-a3ac-448f-ada8-d39e07682174+12:18751:x1870607923966592:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 455us (11580us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951373.270720:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 35 00000100:00100000:3.0:1783951373.273221:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951373.273268:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923966720 00000100:00100000:0.0:1783951373.273278:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923966720 00000100:00100000:0.0:1783951373.273338:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:0.0:1783951373.273349:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ee916a-a3ac-448f-ada8-d39e07682174+12:18751:x1870607923966720:12345-192.168.202.33@tcp:37:lfs.0 00000100:00100000:0.0:1783951373.278129:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62ee916a-a3ac-448f-ada8-d39e07682174+12:18751:x1870607923966720:12345-192.168.202.33@tcp:37:lfs.0 Request processed in 4770us (4905us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951373.278179:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3 00000040:00080000:1.0:1783951373.280797:0:22812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783951373.294971:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951373.295345:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923966976 00000100:00100000:1.0:1783951373.295357:0:22779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923966976 00000100:00100000:1.0:1783951373.295423:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:1.0:1783951373.295434:0:22779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ee916a-a3ac-448f-ada8-d39e07682174+12:18751:x1870607923966976:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:1.0:1783951373.295673:0:22779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62ee916a-a3ac-448f-ada8-d39e07682174+13:18751:x1870607923966976:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 240us (711us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1783951373.295702:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:3.0:1783951373.430413:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951373.436088:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923967104 00000100:00100000:1.0:1783951373.436105:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923967104 00000100:00100000:1.0:1783951373.436227:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 36 00000100:00100000:1.0:1783951373.436239:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+11:18757:x1870607923967104:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:1.0:1783951373.436262:0:22777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951373.436283:0:22777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa07d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc46 expref: -99 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436352:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67200/0x7645c8e1169fa084 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436367:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67200/0x7645c8e1169fa084 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436380:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67200/0x7645c8e1169fa084 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436393:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa08b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436400:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa08b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436406:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa08b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436492:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169fa092 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436521:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169fa092 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436528:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169fa092 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951373.436570:0:22777:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783951373.436575:0:22777:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783951373.436609:0:22777:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169fa092 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436621:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67200/0x7645c8e1169fa084 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436627:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67200/0x7645c8e1169fa084 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436634:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67200/0x7645c8e1169fa084 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436640:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951373.436644:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67200/0x7645c8e1169fa084 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436652:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67200/0x7645c8e1169fa084 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436664:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247832100) 00010000:00010000:1.0:1783951373.436667:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951373.436671:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67200/0x7645c8e1169fa084 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436690:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67200/0x7645c8e1169fa084 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436706:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa08b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436712:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa08b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436717:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa08b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436721:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951373.436724:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa08b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436730:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa08b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436739:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e024109d400) 00010000:00010000:1.0:1783951373.436741:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951373.436744:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa08b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436750:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa08b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436779:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa07d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc46 expref: 13 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436805:0:22777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66400/0x7645c8e1169fa092 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc46 expref: 12 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.436815:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e03427e5700) 00010000:00010000:1.0:1783951373.436818:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783951373.436820:0:22777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66400, rc 0) 00000100:00100000:1.0:1783951373.436899:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+12:18757:x1870607923967104:12345-192.168.202.33@tcp:101:bash.0 Request processed in 661us (6493us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951373.436907:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 36 00000100:00100000:3.0:1783951373.444250:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951373.444358:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923967232 00000100:00100000:0.0:1783951373.444367:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923967232 00000100:00100000:0.0:1783951373.444430:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:0.0:1783951373.444442:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+5:18757:x1870607923967232:12345-192.168.202.33@tcp:900:bash.0 00000100:00100000:0.0:1783951373.444538:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+5:18757:x1870607923967232:12345-192.168.202.33@tcp:900:bash.0 Request processed in 97us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951373.444546:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:3.0:1783951373.454357:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951373.454484:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923967488 00000100:00100000:1.0:1783951373.454495:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923967488 00000100:00100000:1.0:1783951373.454566:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 37 00000100:00100000:1.0:1783951373.454576:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+12:18757:x1870607923967488:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:1.0:1783951373.454598:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951373.454618:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa099 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc4d expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.454731:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa0a0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.454747:0:22778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa076 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc3f expref: 12 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.454757:0:22778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa0a0 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.454791:0:22778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa076 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc3f expref: 12 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951373.454834:0:22778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa076 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc3f expref: 12 pid: 22778 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951373.454849:0:22778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae29880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22778:1870607945045504:192.168.202.33@tcp:104: 00000100:00100000:1.0:1783951373.454947:0:22778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350e3ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1783951373.457518:0:22778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae29880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22778:1870607945045504:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951373.457547:0:22778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa0a0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951373.458266:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951373.458395:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923967616 00000100:00100000:0.0:1783951373.458405:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923967616 00010000:00010000:0.0:1783951373.458442:0:22764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa076 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc3f expref: 13 pid: 22778 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951373.458486:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:0.0:1783951373.458495:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ee916a-a3ac-448f-ada8-d39e07682174+13:2407:x1870607923967616:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951373.458510:0:22764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951373.458517:0:22764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa076 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc3f expref: 13 pid: 22778 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.458529:0:22764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa076 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc3f expref: 13 pid: 22778 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.458552:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa076 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc3f expref: 13 pid: 22778 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.458589:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e03427e5700) 00010000:00010000:0.0:1783951373.458595:0:22764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa0a0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.458606:0:22764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa0a0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.458614:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa0a0 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.458654:0:22764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951373.458713:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62ee916a-a3ac-448f-ada8-d39e07682174+12:2407:x1870607923967616:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 218us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951373.458721:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16 00010000:00010000:2.0:1783951373.458794:0:22778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa0a0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.458813:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa0a0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.458881:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8000/0x7645c8e1169fa0a7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.458893:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8000/0x7645c8e1169fa0a7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.458900:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8000/0x7645c8e1169fa0a7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.459427:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9e00/0x7645c8e1169fa0ae lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.459447:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9e00/0x7645c8e1169fa0ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.459455:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9e00/0x7645c8e1169fa0ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951373.459466:0:22778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783951373.459496:0:22778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa0a0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.459503:0:22778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa0a0 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.459510:0:22778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa0a0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.459516:0:22778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951373.459520:0:22778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa0a0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.459528:0:22778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa0a0 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.459538:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e03427e5700) 00010000:00010000:2.0:1783951373.459541:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951373.459544:0:22778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa0a0 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.459550:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa0a0 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951373.459560:0:22778:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002b2264c2 reply state 00000000e8a8c6b6 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8000/0x7645c8e1169fa0a7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.459578:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8000/0x7645c8e1169fa0a7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.459584:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9e03427e5500) 00010000:00010000:2.0:1783951373.459587:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783951373.459590:0:22778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783951373.459624:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa099 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc4d expref: 15 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.459639:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9e00/0x7645c8e1169fa0ae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc4d expref: 14 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.459647:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:2.0:1783951373.459649:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1783951373.459651:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e036b4a9e00, rc 0) 00000100:00100000:2.0:1783951373.459711:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+15:18757:x1870607923967488:12345-192.168.202.33@tcp:101:bash.0 Request processed in 5136us (5364us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1783951373.459718:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 37 00000100:00100000:3.0:1783951373.479033:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951373.479192:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923967744 00000100:00100000:2.0:1783951373.479204:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923967744 00000100:00100000:2.0:1783951373.479261:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 38 00000100:00100000:2.0:1783951373.479271:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+15:18757:x1870607923967744:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:2.0:1783951373.479301:0:22776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951373.479321:0:22776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9400/0x7645c8e1169fa0bc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc54 expref: -99 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.479392:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9a00/0x7645c8e1169fa0c3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.479420:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9a00/0x7645c8e1169fa0c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.479434:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9a00/0x7645c8e1169fa0c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951373.479504:0:22776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783951373.479509:0:22776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951373.479529:0:22776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9a00/0x7645c8e1169fa0c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.479541:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9a00/0x7645c8e1169fa0c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.479566:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9400/0x7645c8e1169fa0bc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc54 expref: 17 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.479585:0:22776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9a00/0x7645c8e1169fa0c3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc54 expref: 16 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.479594:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:2.0:1783951373.479598:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951373.479601:0:22776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e036b4a9a00, rc 0) 00000100:00100000:2.0:1783951373.479664:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+16:18757:x1870607923967744:12345-192.168.202.33@tcp:101:bash.0 Request processed in 393us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951373.479671:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 38 00000100:00100000:3.0:1783951373.488047:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951373.488193:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923968000 00000100:00100000:1.0:1783951373.488204:0:22779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923968000 00000100:00100000:1.0:1783951373.488269:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:1.0:1783951373.488281:0:22779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+16:18757:x1870607923968000:12345-192.168.202.33@tcp:35:bash.0 00000100:00100000:1.0:1783951373.488592:0:22779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+17:18757:x1870607923968000:12345-192.168.202.33@tcp:35:bash.0 Request processed in 312us (556us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1783951373.488601:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:3.0:1783951373.599549:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951373.602957:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923968256 00000100:00100000:2.0:1783951373.602971:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923968256 00000100:00100000:2.0:1783951373.603187:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 39 00000100:00100000:2.0:1783951373.603210:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+17:18767:x1870607923968256:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:2.0:1783951373.603235:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951373.603255:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9400/0x7645c8e1169fa0ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc5b expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951373.603363:0:22778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783951373.605296:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9400/0x7645c8e1169fa0ca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc5b expref: 19 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.605317:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0247832100) 00010000:00010000:2.0:1783951373.605321:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783951373.605327:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9400/0x7645c8e1169fa0ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc5b expref: 19 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951373.605342:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e036b4a9400, rc 0) 00000100:00100000:2.0:1783951373.605418:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+18:18767:x1870607923968256:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 2208us (5878us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1783951373.605427:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 39 00000100:00100000:3.0:1783951373.614060:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951373.614565:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923968512 00000100:00100000:1.0:1783951373.614575:0:22779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923968512 00000100:00100000:1.0:1783951373.614653:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:1.0:1783951373.614664:0:22779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+18:18767:x1870607923968512:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:1.0:1783951373.615062:0:22779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+19:18767:x1870607923968512:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 398us (1019us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1783951373.615071:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:1.0:1783951373.696138:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951373.700176:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923968768 00000100:00100000:2.0:1783951373.700191:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923968768 00000100:00100000:3.0:1783951373.702214:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 40 00000100:00100000:3.0:1783951373.702229:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036ae29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+19:18770:x1870607923968768:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1783951373.702256:0:22776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951373.702278:0:22776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169fa0d8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc62 expref: -99 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.702399:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609c00/0x7645c8e1169fa0df lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.702414:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609c00/0x7645c8e1169fa0df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.702426:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609c00/0x7645c8e1169fa0df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951373.702438:0:22776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783951373.702557:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169fa0d8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc62 expref: 22 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.702593:0:22776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609c00/0x7645c8e1169fa0df lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc62 expref: 21 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.702602:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:3.0:1783951373.702605:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951373.702609:0:22776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343609c00, rc 0) 00000100:00100000:3.0:1783951373.702687:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036ae29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+21:18770:x1870607923968768:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 461us (6560us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1783951373.702695:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 40 00000100:00100000:2.0:1783951373.714120:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951373.714357:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923968896 00000100:00100000:0.0:1783951373.714367:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923968896 00000100:00100000:2.0:1783951373.714505:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951373.717274:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:0.0:1783951373.717301:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+21:2409:x1870607923968896:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951373.717323:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951373.717353:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343609c00/0x7645c8e1169fa0df lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc62 expref: 21 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951373.717374:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:0.0:1783951373.717380:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951373.717463:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+20:2409:x1870607923968896:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 174us (3352us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951373.717472:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:3.0:1783951373.718156:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923969024 00000100:00100000:3.0:1783951373.718166:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923969024 00000100:00100000:3.0:1783951373.718206:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 41 00000100:00100000:3.0:1783951373.718213:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+20:18770:x1870607923969024:12345-192.168.202.33@tcp:54:lfs.0 00010000:00010000:3.0:1783951373.718268:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169fa0ed lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.718282:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169fa0ed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.718293:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169fa0ed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.718331:0:22778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169fa0ed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.718338:0:22778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169fa0ed lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.718356:0:22778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169fa0ed lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.718362:0:22778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:3.0:1783951373.718367:0:22778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169fa0ed lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.718374:0:22778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169fa0ed lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.718384:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:3.0:1783951373.718387:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783951373.718390:0:22778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169fa0ed lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951373.718396:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169fa0ed lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951373.718449:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+20:18770:x1870607923969024:12345-192.168.202.33@tcp:54:lfs.0 Request processed in 235us (3943us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951373.718456:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 41 00000100:00100000:3.0:1783951373.721741:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951373.721845:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923969280 00000100:00100000:2.0:1783951373.721855:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923969280 00000100:00100000:2.0:1783951373.721916:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:2.0:1783951373.721926:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+20:18770:x1870607923969280:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:2.0:1783951373.722193:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+21:18770:x1870607923969280:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 266us (459us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1783951373.722214:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 7 00010000:00010000:0.0:1783951373.859591:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783951373.985029:0:23527:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783951374.080922:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951374.081174:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923969536 00000100:00100000:0.0:1783951374.081185:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923969536 00000100:00100000:0.0:1783951374.081270:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 42 00000100:00100000:0.0:1783951374.081282:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+21:18801:x1870607923969536:12345-192.168.202.33@tcp:101:cat.0 00010000:00010000:0.0:1783951374.081309:0:22776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951374.081335:0:22776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169fa0f4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc69 expref: -99 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.081447:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169fa0fb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.081462:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169fa0fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.081475:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169fa0fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951374.081487:0:22776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783951374.081613:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169fa0f4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc69 expref: 24 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.081633:0:22776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169fa0fb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc69 expref: 23 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.081640:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:0.0:1783951374.081644:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783951374.081647:0:22776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b3a00, rc 0) 00000100:00100000:0.0:1783951374.081722:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+23:18801:x1870607923969536:12345-192.168.202.33@tcp:101:cat.0 Request processed in 442us (808us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1783951374.081755:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 42 00000100:00080000:2.0:1783951374.082183:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951374.082392:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951374.082427:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951374.082461:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951374.082484:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951374.082529:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923969664 00000100:00100000:3.0:1783951374.082536:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923969664 00000100:00100000:3.0:1783951374.082577:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 163 00000100:00100000:3.0:1783951374.082586:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0247816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:2410:x1870607923969664:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1783951374.082629:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0247816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:705f0753-e3a3-473c-9c20-46e2ee691cf8+13:2410:x1870607923969664:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 45us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951374.082645:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 163 00000100:00100000:2.0:1783951374.082749:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951374.082761:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923969920 00000100:00100000:1.0:1783951374.082766:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923969920 00000100:00100000:2.0:1783951374.082771:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951374.082786:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923970432 00000100:00100000:2.0:1783951374.082789:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923970432 00000100:00100000:1.0:1783951374.082799:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923970048 00000100:00100000:1.0:1783951374.082801:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923970048 00000100:00100000:2.0:1783951374.082812:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:2.0:1783951374.082823:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+5:2410:x1870607923969920:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951374.082828:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:1.0:1783951374.082835:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ee916a-a3ac-448f-ada8-d39e07682174+5:2410:x1870607923970432:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951374.082853:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+5:2410:x1870607923969920:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 35us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951374.082856:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ee916a-a3ac-448f-ada8-d39e07682174+5:2410:x1870607923970432:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 23us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.082860:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:1.0:1783951374.082863:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:2.0:1783951374.082873:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:2.0:1783951374.082878:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+5:2410:x1870607923970048:12345-192.168.202.33@tcp:400:kworker.0 00000100:00080000:1.0:1783951374.082892:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951374.082895:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951374.082900:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+5:2410:x1870607923970048:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 23us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.082906:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:1.0:1783951374.082912:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923970176 00000100:00100000:1.0:1783951374.082915:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923970176 00000100:00080000:1.0:1783951374.082928:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951374.082933:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951374.082945:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923969792 00000100:00100000:1.0:1783951374.082948:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923969792 00000100:00100000:2.0:1783951374.082953:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00080000:1.0:1783951374.082959:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951374.082964:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923970560 00000100:00100000:2.0:1783951374.082967:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923970560 00000100:00100000:1.0:1783951374.082969:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923970304 00000100:00100000:1.0:1783951374.082971:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923970304 00000100:00100000:1.0:1783951374.083000:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 52 00000100:00100000:2.0:1783951374.083002:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:1.0:1783951374.083006:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ee916a-a3ac-448f-ada8-d39e07682174+12:2410:x1870607923970176:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1783951374.083014:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ee916a-a3ac-448f-ada8-d39e07682174+5:2410:x1870607923970560:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951374.083036:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62ee916a-a3ac-448f-ada8-d39e07682174+12:2410:x1870607923970176:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 30us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951374.083042:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 52 00000100:00100000:1.0:1783951374.083055:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 53 00000100:00100000:1.0:1783951374.083062:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+5:2410:x1870607923969792:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1783951374.083177:0:22777:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783951374.083186:0:22777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1783951374.083202:0:22776:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783951374.083211:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 54 00000100:00100000:0.0:1783951374.083219:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee916a-a3ac-448f-ada8-d39e07682174+5:2410:x1870607923970304:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1783951374.085282:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+5:2410:x1870607923969792:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 2209us (2521us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951374.085313:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 53 00000100:00080000:1.0:1783951374.085384:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951374.087287:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:62ee916a-a3ac-448f-ada8-d39e07682174+5:2410:x1870607923970560:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 4262us (4322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.087301:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:0.0:1783951374.087651:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62ee916a-a3ac-448f-ada8-d39e07682174+5:2410:x1870607923970304:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 4429us (4713us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951374.087666:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 54 00000100:00100000:2.0:1783951374.087670:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951374.087755:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951374.087840:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923970688 00000100:00100000:1.0:1783951374.087849:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923970688 00000100:00100000:1.0:1783951374.087909:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 1 00000100:00100000:1.0:1783951374.087919:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+23:2410:x1870607923970688:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951374.087935:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951374.087959:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3a00/0x7645c8e1169fa0fb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc69 expref: 23 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.087988:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:1.0:1783951374.087993:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951374.088031:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+22:2410:x1870607923970688:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 114us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951374.088038:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 1 00000100:00100000:0.0:1783951374.089540:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923970944 00000100:00100000:0.0:1783951374.089551:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923970944 00000100:00100000:0.0:1783951374.089601:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:0.0:1783951374.089611:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+22:18801:x1870607923970944:12345-192.168.202.33@tcp:35:cat.0 00000100:00100000:0.0:1783951374.089935:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+23:18801:x1870607923970944:12345-192.168.202.33@tcp:35:cat.0 Request processed in 324us (2178us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1783951374.089943:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:1.0:1783951374.154395:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951374.154499:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923971200 00000100:00100000:3.0:1783951374.154509:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923971200 00000100:00100000:3.0:1783951374.154612:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 43 00000100:00100000:3.0:1783951374.154624:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036ae29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+23:18808:x1870607923971200:12345-192.168.202.33@tcp:101:dd.0 00010000:00010000:3.0:1783951374.154650:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951374.154671:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169fa109 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc70 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951374.154795:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169fa110 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951374.154812:0:22778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9e00/0x7645c8e1169fa0ae lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc4d expref: 24 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951374.154833:0:22778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9a00/0x7645c8e1169fa0c3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc54 expref: 24 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951374.154842:0:22778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169fa110 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951374.154877:0:22778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9a00/0x7645c8e1169fa0c3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc54 expref: 24 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951374.154890:0:22778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9a00/0x7645c8e1169fa0c3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc54 expref: 24 pid: 22776 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951374.154903:0:22778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036aeb4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22778:1870607945045632:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951374.155049:0:22778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9e00/0x7645c8e1169fa0ae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc4d expref: 24 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951374.155059:0:22778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9e00/0x7645c8e1169fa0ae lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc4d expref: 24 pid: 22778 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951374.155069:0:22778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036aeb6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22778:1870607945045760:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951374.155089:0:22778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037cb1b240 going to sleep for 11 seconds 00000100:00100000:3.0:1783951374.158130:0:22778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036aeb4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22778:1870607945045632:192.168.202.33@tcp:104: 00000100:00100000:3.0:1783951374.158165:0:22778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036aeb6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22778:1870607945045760:192.168.202.33@tcp:104: 00010000:00010000:3.0:1783951374.158191:0:22778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169fa110 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951374.158583:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951374.158656:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951374.159494:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923971328 00000100:00100000:2.0:1783951374.159504:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923971328 00010000:00010000:2.0:1783951374.159548:0:22762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9a00/0x7645c8e1169fa0c3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc54 expref: 25 pid: 22776 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951374.159632:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923971456 00000100:00100000:2.0:1783951374.159635:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923971456 00010000:00010000:2.0:1783951374.159648:0:22762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9e00/0x7645c8e1169fa0ae lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc4d expref: 26 pid: 22778 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951374.159664:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:2.0:1783951374.159672:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036ae2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+26:2408:x1870607923971328:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951374.159687:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951374.159695:0:22762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9a00/0x7645c8e1169fa0c3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc54 expref: 26 pid: 22776 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.159707:0:22762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9a00/0x7645c8e1169fa0c3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc54 expref: 26 pid: 22776 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.159729:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9a00/0x7645c8e1169fa0c3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc54 expref: 26 pid: 22776 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.159763:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:2.0:1783951374.159768:0:22762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169fa110 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.159777:0:22762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169fa110 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.159784:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951374.159934:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036ae2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+25:2408:x1870607923971328:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 261us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.159942:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:2.0:1783951374.159959:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:2.0:1783951374.159966:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036c661450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+24:2408:x1870607923971456:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951374.159988:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951374.159994:0:22762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9e00/0x7645c8e1169fa0ae lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc4d expref: 24 pid: 22778 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.160005:0:22762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9e00/0x7645c8e1169fa0ae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc4d expref: 24 pid: 22778 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.160017:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9e00/0x7645c8e1169fa0ae lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc4d expref: 24 pid: 22778 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.160027:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:2.0:1783951374.160030:0:22762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169fa110 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.160050:0:22762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169fa110 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.160058:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169fa110 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.160083:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951374.160101:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036c661450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+23:2408:x1870607923971456:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 136us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.160108:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18 00010000:00010000:2.0:1783951374.160229:0:22778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169fa110 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.160237:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169fa110 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951374.160255:0:22778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783951374.160424:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608600/0x7645c8e1169fa109 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc70 expref: 24 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.160439:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608800/0x7645c8e1169fa110 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc70 expref: 23 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.160448:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:2.0:1783951374.160451:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783951374.160453:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0343608800, rc 0) 00000100:00100000:2.0:1783951374.160479:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036ae29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+23:18808:x1870607923971200:12345-192.168.202.33@tcp:101:dd.0 Request processed in 5859us (6095us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1783951374.160495:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 43 00000100:00100000:3.0:1783951374.163724:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951374.163807:0:25821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923971584 00000100:00100000:1.0:1783951374.163816:0:25821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923971584 00000100:00100000:1.0:1783951374.163880:0:25821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 44 00000100:00100000:1.0:1783951374.163889:0:25821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+23:18808:x1870607923971584:12345-192.168.202.33@tcp:101:dd.0 00010000:00010000:1.0:1783951374.163912:0:25821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951374.163931:0:25821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa11e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc77 expref: -99 pid: 25821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.164002:0:25821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa125 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.164015:0:25821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa125 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.164026:0:25821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa125 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.164181:0:25821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa11e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc77 expref: 25 pid: 25821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.164197:0:25821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa125 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc77 expref: 24 pid: 25821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.164205:0:25821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:1.0:1783951374.164208:0:25821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783951374.164211:0:25821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67800, rc 0) 00000100:00100000:1.0:1783951374.167546:0:25821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+24:18808:x1870607923971584:12345-192.168.202.33@tcp:101:dd.0 Request processed in 3645us (3819us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951374.167559:0:25821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 44 00000100:00100000:3.0:1783951374.173192:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951374.173576:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923971840 00000100:00100000:1.0:1783951374.173584:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923971840 00000100:00100000:1.0:1783951374.173637:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 45 00000100:00100000:1.0:1783951374.173646:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+24:18808:x1870607923971840:12345-192.168.202.33@tcp:36:dd.0 00010000:00010000:1.0:1783951374.173901:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa12c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.173935:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa12c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.173948:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa12c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783951374.174042:0:22777:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1783951374.174067:0:22777:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000082ef27ae reply state 00000000cf527a28 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa12c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.174081:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa12c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.174088:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:1.0:1783951374.174092:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783951374.174096:0:22777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783951374.174217:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+27:18808:x1870607923971840:12345-192.168.202.33@tcp:36:dd.0 Request processed in 570us (1081us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1783951374.174226:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 45 00000020:00080000:1.0:1783951374.174232:0:22777:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783951374.185447:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951374.185511:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923971968 00000100:00100000:0.0:1783951374.185521:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923971968 00000100:00100000:0.0:1783951374.185582:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 46 00000100:00100000:0.0:1783951374.185598:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+27:18808:x1870607923971968:12345-192.168.202.33@tcp:101:dd.0 00010000:00010000:0.0:1783951374.185626:0:22776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951374.185648:0:22776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa133 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc7e expref: -99 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.185717:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa133 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc7e expref: 28 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.185749:0:22776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa133 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc7e expref: 28 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.185770:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:0.0:1783951374.185773:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783951374.185776:0:22776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e037d2b2a00, rc 0) 00000100:00100000:0.0:1783951374.185855:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+28:18808:x1870607923971968:12345-192.168.202.33@tcp:101:dd.0 Request processed in 259us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951374.185863:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 46 00000100:00100000:0.0:1783951374.199134:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951374.199405:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923972224 00000100:00100000:2.0:1783951374.199415:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923972224 00000100:00100000:2.0:1783951374.199515:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 2 00000100:00100000:2.0:1783951374.199527:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+28:18808:x1870607923972224:12345-192.168.202.33@tcp:103:dd.0 00010000:00010000:2.0:1783951374.199544:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951374.199569:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa133 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc7e expref: 28 pid: 22776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.199588:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:2.0:1783951374.199594:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951374.199656:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+27:18808:x1870607923972224:12345-192.168.202.33@tcp:103:dd.0 Request processed in 132us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.199664:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 2 00000100:00100000:3.0:1783951374.202223:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951374.202328:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923972352 00000100:00100000:1.0:1783951374.202337:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923972352 00000100:00100000:1.0:1783951374.202396:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 47 00000100:00100000:1.0:1783951374.202406:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+27:18808:x1870607923972352:12345-192.168.202.33@tcp:58:dd.0 00010000:00010000:1.0:1783951374.202545:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa13a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.202563:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa13a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.202585:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa13a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783951374.203813:0:22777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783951374.203861:0:22777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1783951374.204034:0:22777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1783951374.204381:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+27:18808:x1870607923972352:12345-192.168.202.33@tcp:58:dd.0 Request processed in 1971us (2164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951374.204392:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 47 00000100:00100000:3.0:1783951374.207023:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951374.207106:0:25821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923972480 00000100:00100000:1.0:1783951374.207115:0:25821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923972480 00000100:00100000:1.0:1783951374.207190:0:25821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 48 00000100:00100000:1.0:1783951374.207201:0:25821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+27:18808:x1870607923972480:12345-192.168.202.33@tcp:101:dd.0 00010000:00010000:1.0:1783951374.207222:0:25821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951374.207241:0:25821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169fa141 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc85 expref: -99 pid: 25821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.207307:0:25821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa13a lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.207319:0:25821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169fa141 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc85 expref: 28 pid: 25821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.207337:0:25821:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa13a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.207349:0:25821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169fa141 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc85 expref: 28 pid: 25821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.207380:0:25821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:1.0:1783951374.207384:0:25821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783951374.207389:0:25821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169fa141 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc85 expref: 28 pid: 25821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.207396:0:25821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66800, rc 0) 00000100:00100000:1.0:1783951374.207717:0:25821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+28:18808:x1870607923972480:12345-192.168.202.33@tcp:101:dd.0 Request processed in 516us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951374.207725:0:25821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 48 00000040:00080000:1.0:1783951374.304462:0:22812:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1783951374.304471:0:22812:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783951374.304497:0:22812:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1783951374.304508:0:22812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1783951374.304648:0:22812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae28000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22812:1870607945045888:192.168.202.33@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783951374.304738:0:22812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0350e3ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1783951374.310340:0:22812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae28000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22812:1870607945045888:192.168.202.33@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783951374.316184:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951374.316443:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923972608 00000100:00100000:2.0:1783951374.316453:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923972608 00000100:00100000:2.0:1783951374.316517:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 49 00000100:00100000:2.0:1783951374.316528:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+28:18809:x1870607923972608:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783951374.316561:0:22778:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783951374.316689:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+28:18809:x1870607923972608:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 Request processed in 162us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.316697:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 49 00000100:00100000:3.0:1783951374.322347:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951374.322693:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923972736 00000100:00100000:0.0:1783951374.322704:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923972736 00000100:00100000:0.0:1783951374.322770:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 50 00000100:00100000:0.0:1783951374.322780:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+28:18809:x1870607923972736:12345-192.168.202.33@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783951374.322873:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa148 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.322890:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa148 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.322902:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa148 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.322954:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa14f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.322962:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa14f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.322993:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa14f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323017:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169fa156 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323026:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169fa156 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323032:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169fa156 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951374.323327:0:22776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783951374.323332:0:22776:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783951374.323344:0:22776:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169fa156 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323354:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa148 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323360:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa148 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323366:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa148 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323373:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b3c00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951374.323377:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa148 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323384:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa148 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323404:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e0347f05600) 00010000:00010000:0.0:1783951374.323407:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951374.323413:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa148 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323418:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa148 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323432:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa14f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323439:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa14f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323445:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa14f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323450:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951374.323453:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa14f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323459:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa14f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323466:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9e0247832700) 00010000:00010000:0.0:1783951374.323468:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951374.323471:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa14f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323477:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa14f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323503:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169fa156 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323509:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169fa156 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323515:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169fa156 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323520:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951374.323523:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169fa156 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323529:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169fa156 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323537:0:22776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:0.0:1783951374.323539:0:22776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951374.323542:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169fa156 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.323547:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2e00/0x7645c8e1169fa156 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951374.323749:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+28:18809:x1870607923972736:12345-192.168.202.33@tcp:34:lhsmtool_posix.0 Request processed in 967us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951374.323758:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 50 00000100:00100000:3.0:1783951374.329498:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951374.329598:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923972992 00000100:00100000:2.0:1783951374.329609:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923972992 00000100:00100000:2.0:1783951374.329689:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 51 00000100:00100000:2.0:1783951374.329714:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+28:18809:x1870607923972992:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951374.329737:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951374.329759:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9a00/0x7645c8e1169fa15d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc8c expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.330216:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa164 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.330235:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa164 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.330249:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa164 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951374.330262:0:22778:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783951374.330356:0:22778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa164 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.330364:0:22778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa164 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.330370:0:22778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa164 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.330377:0:22778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e036b4a8c00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951374.330381:0:22778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa164 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.330388:0:22778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa164 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.330401:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:2.0:1783951374.330411:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783951374.330418:0:22778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa164 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.330424:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa164 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.330471:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9a00/0x7645c8e1169fa15d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc8c expref: 30 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.330483:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e0347f05600) 00010000:00010000:2.0:1783951374.330485:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783951374.330489:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9a00/0x7645c8e1169fa15d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc8c expref: 30 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.330497:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e036b4a9a00, rc 0) 00000100:00100000:2.0:1783951374.330567:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+29:18809:x1870607923972992:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 855us (1079us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1783951374.330575:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 51 00000100:00100000:3.0:1783951374.334484:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951374.334691:0:25821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923973120 00000100:00100000:1.0:1783951374.334701:0:25821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923973120 00000100:00100000:1.0:1783951374.334836:0:25821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 52 00000100:00100000:1.0:1783951374.334849:0:25821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+29:18809:x1870607923973120:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783951374.334885:0:25821:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783951374.335019:0:25821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+29:18809:x1870607923973120:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 Request processed in 172us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951374.335027:0:25821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 52 00000100:00100000:3.0:1783951374.338340:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951374.338417:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923973376 00000100:00100000:1.0:1783951374.338428:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923973376 00000100:00100000:1.0:1783951374.338527:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 53 00000100:00100000:1.0:1783951374.338539:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+29:18809:x1870607923973376:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951374.338562:0:22777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951374.338586:0:22777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169fa172 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc93 expref: -99 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783951374.339446:0:22777:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =60 00000004:00080000:1.0:1783951374.339455:0:22777:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+60 in llog 00000004:00080000:1.0:1783951374.339479:0:22777:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:1.0:1783951374.339672:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66000/0x7645c8e1169fa179 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.339689:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66000/0x7645c8e1169fa179 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.339703:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66000/0x7645c8e1169fa179 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.341610:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169fa172 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc93 expref: 32 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.341641:0:22777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66000/0x7645c8e1169fa179 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc93 expref: 31 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.341651:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e0347f05f00) 00010000:00010000:1.0:1783951374.341654:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951374.341658:0:22777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66000, rc 0) 00000100:00100000:1.0:1783951374.341766:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+31:18809:x1870607923973376:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 3228us (3433us total) trans 12884901908 rc 0/0 00000100:00100000:1.0:1783951374.341775:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 53 00000100:00100000:3.0:1783951374.351042:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951374.351188:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923973632 00000100:00100000:0.0:1783951374.351206:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923973632 00000100:00100000:1.0:1783951374.351643:0:25821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 54 00000100:00100000:1.0:1783951374.351656:0:25821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aeb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+31:18809:x1870607923973632:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783951374.351713:0:25821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951374.351740:0:25821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66000/0x7645c8e1169fa179 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc93 expref: 31 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.351760:0:25821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e0347f05f00) 00010000:00010000:1.0:1783951374.351770:0:25821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951374.351790:0:25821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169fa187 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.351804:0:25821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169fa187 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.351813:0:25821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169fa187 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.351877:0:25821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa18e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb215129c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.351885:0:25821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa18e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb215129c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.351892:0:25821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa18e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb215129c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.351943:0:25821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169fa187 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.351962:0:25821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169fa187 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.351984:0:25821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169fa187 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.351991:0:25821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67e00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951374.351995:0:25821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169fa187 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.352003:0:25821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169fa187 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.352013:0:25821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e03427e5700) 00010000:00010000:1.0:1783951374.352016:0:25821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951374.352019:0:25821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169fa187 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.352025:0:25821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169fa187 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.352034:0:25821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa18e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb215129c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.352040:0:25821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa18e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb215129c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.352046:0:25821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa18e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb215129c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.352051:0:25821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66c00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:1.0:1783951374.352059:0:25821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa18e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb215129c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.352065:0:25821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa18e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb215129c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.352071:0:25821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb215129c (ffff9e0347f05900) 00010000:00010000:1.0:1783951374.352073:0:25821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951374.352076:0:25821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa18e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb215129c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.352081:0:25821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa18e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb215129c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951374.352935:0:25821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aeb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+30:18809:x1870607923973632:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 1277us (1899us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783951374.352944:0:25821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 54 00000100:00100000:3.0:1783951374.359951:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951374.360091:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923973760 00000100:00100000:2.0:1783951374.360102:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923973760 00000100:00100000:1.0:1783951374.360489:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 55 00000100:00100000:1.0:1783951374.360504:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+30:18809:x1870607923973760:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951374.360539:0:22777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951374.360562:0:22777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa195 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fc9a expref: -99 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.360600:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169fa19c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.360615:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169fa19c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.360628:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169fa19c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.360763:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa195 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc9a expref: 32 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.360782:0:22777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67e00/0x7645c8e1169fa19c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc9a expref: 31 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.360791:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e0347f05900) 00010000:00010000:1.0:1783951374.360795:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783951374.360798:0:22777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a67e00, rc 0) 00000100:00100000:1.0:1783951374.360859:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+31:18809:x1870607923973760:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 360us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951374.360866:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 55 00000100:00100000:3.0:1783951374.366357:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951374.368635:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923974016 00000100:00100000:0.0:1783951374.368667:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923974016 00000100:00100000:1.0:1783951374.368832:0:25821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 56 00000100:00100000:1.0:1783951374.368846:0:25821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+31:18809:x1870607923974016:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783951374.368942:0:25821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa1a3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.368959:0:25821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa1a3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.368981:0:25821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa1a3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783951374.369192:0:25821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:1.0:1783951374.369203:0:25821:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 730017060032ns, next at 731017058023ns, rc = 0 00000004:00010000:1.0:1783951374.369254:0:25821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000460ccaea reply state 00000000ece29226 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa1a3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.369273:0:25821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa1a3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.369279:0:25821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e0347f05900) 00010000:00010000:1.0:1783951374.369281:0:25821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783951374.369283:0:25821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783951374.369455:0:25821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+33:18809:x1870607923974016:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 611us (3106us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1783951374.369464:0:25821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 56 00000100:00100000:3.0:1783951374.373463:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951374.373571:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923974144 00000100:00100000:1.0:1783951374.373581:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923974144 00000100:00100000:1.0:1783951374.373638:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 57 00000100:00100000:1.0:1783951374.373649:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+33:18809:x1870607923974144:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783951374.373676:0:22777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951374.373694:0:22777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66000/0x7645c8e1169fa1aa lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fca1 expref: -99 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.373768:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66000/0x7645c8e1169fa1aa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fca1 expref: 34 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.373781:0:22777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66000/0x7645c8e1169fa1aa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fca1 expref: 34 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.373797:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e0347f05900) 00010000:00010000:1.0:1783951374.373800:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783951374.373802:0:22777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0247a66000, rc 0) 00000100:00100000:1.0:1783951374.373865:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+34:18809:x1870607923974144:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 217us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951374.373887:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 57 00000100:00100000:3.0:1783951374.378909:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951374.379320:0:25206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923974272 00000100:00100000:1.0:1783951374.379331:0:25206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923974272 00000100:00100000:1.0:1783951374.379644:0:25206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:1.0:1783951374.379656:0:25206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+5:2408:x1870607923974272:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1783951374.379964:0:25206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:2408:x1870607923974272:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 Request processed in 311us (1063us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1783951374.379984:0:25206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:3.0:1783951374.383610:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951374.383864:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923974528 00000100:00100000:0.0:1783951374.383874:0:22779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923974528 00000100:00100000:0.0:1783951374.383934:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 9 00000100:00100000:0.0:1783951374.383945:0:22779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+34:18809:x1870607923974528:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783951374.384244:0:22779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+35:18809:x1870607923974528:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 299us (642us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1783951374.384252:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 9 00000100:00100000:2.0:1783951374.392525:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951374.392625:0:25821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923974784 00000100:00100000:1.0:1783951374.392634:0:25821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923974784 00000100:00100000:1.0:1783951374.392702:0:25821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 58 00000100:00100000:1.0:1783951374.392721:0:25821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+35:18809:x1870607923974784:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783951374.392853:0:25821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+35:18809:x1870607923974784:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 141us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951374.392861:0:25821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 58 00000100:00100000:0.0:1783951374.398012:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951374.398174:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923974912 00000100:00100000:2.0:1783951374.398185:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923974912 00000100:00100000:2.0:1783951374.398250:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 59 00000100:00100000:2.0:1783951374.398261:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+35:18809:x1870607923974912:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951374.398284:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951374.398305:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9a00/0x7645c8e1169fa1b1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fca8 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.398398:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa1b8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.398414:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa1b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.398426:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa1b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951374.398477:0:22778:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951374.398496:0:22778:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa1b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.398518:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9a00/0x7645c8e1169fa1b1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fca8 expref: 37 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.398536:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa1b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fca8 expref: 36 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.398544:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e0347f05900) 00010000:00010000:2.0:1783951374.398547:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783951374.398551:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e036b4a8c00, rc 0) 00000100:00100000:2.0:1783951374.398606:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+36:18809:x1870607923974912:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 347us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.398614:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 59 00000100:00100000:1.0:1783951374.402810:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951374.404403:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923975040 00000100:00100000:2.0:1783951374.404415:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923975040 00000100:00100000:2.0:1783951374.404478:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:2.0:1783951374.404504:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036ae28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:2408:x1870607923975040:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951374.404525:0:24283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951374.404548:0:24283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b50ebb6/0x7645c8e1169fa1bf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fcaf expref: -99 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783951374.404576:0:24283:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54f00e, blocks: 0x0 00010000:00010000:2.0:1783951374.404598:0:24283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=730s v=(0 0) 00010000:00010000:2.0:1783951374.404603:0:24283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951374.404613:0:24283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b50ebb6/0x7645c8e1169fa1bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcaf expref: 7 pid: 24283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.404633:0:24283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b50ebb6/0x7645c8e1169fa1bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcaf expref: 7 pid: 24283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.404647:0:24283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e036b4a8a00, rc 0) 00000100:00100000:2.0:1783951374.404726:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036ae28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+7:2408:x1870607923975040:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 223us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.404734:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:1.0:1783951374.410832:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951374.411178:0:25821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923975296 00000100:00100000:3.0:1783951374.411189:0:25821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923975296 00000100:00100000:3.0:1783951374.411248:0:25821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 60 00000100:00100000:3.0:1783951374.411260:0:25821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036ae2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+36:18809:x1870607923975296:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783951374.411378:0:25821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036ae2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+36:18809:x1870607923975296:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 121us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951374.411386:0:25821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 60 00000100:00100000:3.0:1783951374.422894:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951374.423139:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923975424 00000100:00100000:2.0:1783951374.423188:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923975424 00000100:00100000:2.0:1783951374.423256:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 61 00000100:00100000:2.0:1783951374.423267:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+36:18809:x1870607923975424:12345-192.168.202.33@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783951374.431171:0:22757:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:3.0:1783951374.431200:0:22757:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1783951374.431254:0:22757:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:3.0:1783951374.432090:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945046016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783951374.432214:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951374.432706:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607945046528:0@lo:400:kworker.0 00000100:00100000:1.0:1783951374.432749:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951374.432771:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036aebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607945047040:0@lo:400:kworker.0 00000100:00100000:1.0:1783951374.432791:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951374.432804:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e038112b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607945047552:0@lo:400:kworker.0 00000100:00100000:1.0:1783951374.432821:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951374.432838:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783951374.432855:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b1b2cfa-7097-4258-904b-0084ac551497:3652:1870607945046144:0@lo:400:kworker.0 00000100:00100000:1.0:1783951374.432884:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951374.432908:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945046656:0@lo:400:kworker.0 00000100:00100000:1.0:1783951374.432931:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951374.432947:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607945047168:0@lo:400:kworker.0 00000100:00100000:1.0:1783951374.432967:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951374.433190:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945046272:0@lo:400:kworker.0 00000100:00100000:1.0:1783951374.433217:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951374.433235:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945046784:0@lo:400:kworker.0 00000100:00100000:1.0:1783951374.433255:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951374.433284:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037fc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607945047296:0@lo:400:kworker.0 00000100:00100000:1.0:1783951374.433304:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951374.433318:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783951374.433323:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945046400:0@lo:400:kworker.0 00000100:00100000:1.0:1783951374.433343:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951374.433359:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036ae2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945046912:0@lo:400:kworker.0 00000100:00100000:1.0:1783951374.433381:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951374.433395:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0381128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607945047424:0@lo:400:kworker.0 00000100:00100000:1.0:1783951374.433411:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951374.433435:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945046144 00000100:00100000:1.0:1783951374.433442:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945046144 00000100:00100000:1.0:1783951374.433488:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783951374.433497:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e02485bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+24:3652:x1870607945046144:12345-0@lo:400:kworker.0 00010000:00010000:2.0:1783951374.433693:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169fa04c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.433705:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169fa04c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.433719:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169fa04c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.433734:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2200 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:2.0:1783951374.433738:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169fa04c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.433747:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169fa04c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.433763:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e03427e5700) 00010000:00010000:2.0:1783951374.433767:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1783951374.433771:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169fa04c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.433776:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2200/0x7645c8e1169fa04c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951374.433843:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945046016 00000100:00100000:2.0:1783951374.433847:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945046016 00000100:00100000:2.0:1783951374.433883:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945046784 00000100:00100000:2.0:1783951374.433886:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945046784 00000100:00100000:2.0:1783951374.433900:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945046400 00000100:00100000:2.0:1783951374.433902:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945046400 00000100:00100000:2.0:1783951374.433913:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945046912 00000100:00100000:2.0:1783951374.433915:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945046912 00000100:00100000:2.0:1783951374.433928:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783951374.433934:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945046784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951374.433996:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945046784:12345-0@lo:400:kworker.0 Request processed in 61us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.434014:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783951374.434029:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783951374.434035:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945046400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951374.434064:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945046400:12345-0@lo:400:kworker.0 Request processed in 28us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.434070:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783951374.434080:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783951374.434086:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036bccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945046912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951374.434110:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036bccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945046912:12345-0@lo:400:kworker.0 Request processed in 25us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.434115:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783951374.434125:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783951374.434131:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607945046016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1783951374.434286:0:24282:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783951374.434289:0:24282:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1783951374.434291:0:24282:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783951374.434293:0:24282:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1783951374 -> 1783951374 00002000:00010000:2.0:1783951374.434295:0:24282:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1783951374.434324:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1870607945046016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 192us (2110us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1783951374.434330:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1783951374.434506:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783951374.434510:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951374.434557:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945046400:0@lo:400:kworker.0 00000100:00100000:2.0:1783951374.434567:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945046912:0@lo:400:kworker.0 00000100:00100000:2.0:1783951374.434583:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945046784:0@lo:400:kworker.0 00000004:00080000:2.0:1783951374.434633:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e036ae29c00/2, rc 0, transno 12884901892 00000100:00100000:2.0:1783951374.434639:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945046016:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783951374.434644:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951374.434654:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945047680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951374.434679:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951374.434708:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945047680 00000100:00100000:2.0:1783951374.434711:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945047680 00000100:00100000:2.0:1783951374.434737:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783951374.434745:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607945047680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951374.434767:0:24284:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1783951374.434799:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1870607945047680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.434805:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783951374.434837:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3652:1870607945047680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951374.434955:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+19:18809:x1870607923975424:12345-192.168.202.33@tcp:44:lhsmtool_posix.0 Request processed in 11687us (12067us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.434963:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 61 00000100:00100000:2.0:1783951374.434986:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945046528 00000100:00100000:2.0:1783951374.434990:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945046528 00000100:00100000:2.0:1783951374.435006:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945047040 00000100:00100000:2.0:1783951374.435008:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945047040 00000100:00100000:2.0:1783951374.435017:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945047552 00000100:00100000:2.0:1783951374.435019:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945047552 00000100:00100000:2.0:1783951374.435036:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945047168 00000100:00100000:2.0:1783951374.435038:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945047168 00000100:00100000:2.0:1783951374.435059:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945047296 00000100:00100000:2.0:1783951374.435063:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945047296 00000100:00100000:2.0:1783951374.435071:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945047424 00000100:00100000:2.0:1783951374.435074:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945047424 00000100:00100000:2.0:1783951374.435085:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783951374.435090:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607945046528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951374.435128:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1870607945046528:12345-0@lo:400:kworker.0 Request processed in 37us (2378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.435135:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783951374.435169:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783951374.435175:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0381128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607945047040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951374.435203:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0381128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1870607945047040:12345-0@lo:400:kworker.0 Request processed in 28us (2410us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.435208:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783951374.435219:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783951374.435226:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607945047552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951374.435252:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1870607945047552:12345-0@lo:400:kworker.0 Request processed in 27us (2429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.435257:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783951374.435268:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783951374.435274:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0377abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607945047168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951374.435301:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0377abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1870607945047168:12345-0@lo:400:kworker.0 Request processed in 27us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.435307:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783951374.435319:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783951374.435325:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607945047296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951374.435368:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1870607945047296:12345-0@lo:400:kworker.0 Request processed in 44us (2063us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.435374:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1783951374.435407:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e037fc65880 x1870607945047296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951374.435418:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3654:1870607945047296:0@lo:400:kworker.0 00000100:00080000:2.0:1783951374.435434:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783951374.435437:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951374.435455:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3652:1870607945047168:0@lo:400:kworker.0 00000100:00100000:2.0:1783951374.435466:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3652:1870607945046528:0@lo:400:kworker.0 00000100:00100000:2.0:1783951374.435476:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036aebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3652:1870607945047040:0@lo:400:kworker.0 00010000:00080000:2.0:1783951374.435489:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e038112b100 x1870607945047552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783951390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951374.435497:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e038112b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3652:1870607945047552:0@lo:400:kworker.0 00000100:00100000:2.0:1783951374.435521:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783951374.435528:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607945047424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951374.435561:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1870607945047424:12345-0@lo:400:kworker.0 Request processed in 34us (2149us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.435567:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783951374.435605:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0381128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3654:1870607945047424:0@lo:400:kworker.0 00000100:00100000:1.0:1783951374.436326:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e02485bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b1b2cfa-7097-4258-904b-0084ac551497+24:3652:x1870607945046144:12345-0@lo:400:kworker.0 Request processed in 2827us (3438us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951374.436345:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783951374.436384:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945046656 00000100:00100000:1.0:1783951374.436390:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945046656 00000100:00100000:1.0:1783951374.436412:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945046272 00000100:00100000:1.0:1783951374.436415:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945046272 00000100:00100000:1.0:1783951374.436428:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783951374.436434:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e038112aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945046656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951374.436469:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e038112aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1870607945046656:12345-0@lo:400:kworker.0 Request processed in 35us (3537us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951374.436475:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783951374.436487:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783951374.436492:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03489c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945046272:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1783951374.437043:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f9fc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437057:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f9fc0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437069:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f9fc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437075:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0343608400 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951374.437079:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f9fc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437086:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f9fc0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437102:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e024109d400) 00010000:00010000:0.0:1783951374.437105:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951374.437110:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f9fc0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437128:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0343608400/0x7645c8e1169f9fc0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437165:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9000/0x7645c8e1169f9fc7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437171:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9000/0x7645c8e1169f9fc7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437176:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9000/0x7645c8e1169f9fc7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437181:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e036b4a9000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951374.437184:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9000/0x7645c8e1169f9fc7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437189:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9000/0x7645c8e1169f9fc7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437197:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e03427e5700) 00010000:00010000:0.0:1783951374.437200:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951374.437202:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9000/0x7645c8e1169f9fc7 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437208:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a9000/0x7645c8e1169f9fc7 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437220:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8000/0x7645c8e1169fa0a7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437226:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8000/0x7645c8e1169fa0a7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437238:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8000/0x7645c8e1169fa0a7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437244:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e036b4a8000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951374.437247:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8000/0x7645c8e1169fa0a7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437253:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8000/0x7645c8e1169fa0a7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437278:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9e03427e5500) 00010000:00010000:0.0:1783951374.437280:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951374.437283:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8000/0x7645c8e1169fa0a7 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437290:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8000/0x7645c8e1169fa0a7 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437305:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa12c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437310:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa12c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437316:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa12c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437320:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951374.437322:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa12c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437339:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa12c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437347:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:0.0:1783951374.437349:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951374.437352:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa12c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437356:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa12c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437367:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa1a3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437372:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa1a3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437377:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa1a3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437381:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66c00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951374.437383:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa1a3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437388:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa1a3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437394:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e0347f05900) 00010000:00010000:0.0:1783951374.437396:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783951374.437398:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa1a3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.437412:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66c00/0x7645c8e1169fa1a3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951374.437467:0:3655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e034121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945047936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951374.442187:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036aed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945047808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951374.443311:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951374.443408:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945047936 00000100:00100000:0.0:1783951374.443417:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945047936 00000100:00100000:0.0:1783951374.443464:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783951374.443475:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607945047936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951374.443502:0:24284:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1783951374.443561:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1870607945047936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951374.443568:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783951374.443620:0:3655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e034121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3655:1870607945047936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951374.444055:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03489c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1870607945046272:12345-0@lo:400:kworker.0 Request processed in 7560us (10834us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951374.444067:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783951374.444222:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b1b2cfa-7097-4258-904b-0084ac551497:3652:1870607945046144:0@lo:400:kworker.0 00000100:00100000:0.0:1783951374.444236:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3652:1870607945046656:0@lo:400:kworker.0 00000100:00100000:2.0:1783951374.444365:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951374.444501:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036ae28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945046272:0@lo:400:kworker.0 00000100:00100000:3.0:1783951374.444655:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951374.444846:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923975552 00000100:00100000:2.0:1783951374.444852:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923975552 00000100:00100000:2.0:1783951374.444894:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:2.0:1783951374.444903:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+7:2410:x1870607923975552:12345-192.168.202.33@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1783951374.445079:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+7:2410:x1870607923975552:12345-192.168.202.33@tcp:16:lhsmtool_posix.0 Request processed in 175us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.445087:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:0.0:1783951374.445132:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945047808 00000100:00100000:0.0:1783951374.445136:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945047808 00000100:00100000:1.0:1783951374.445248:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783951374.445266:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1870607945047808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951374.445289:0:24284:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783951374.445331:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1870607945047808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951374.445338:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783951374.445476:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036aed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3654:1870607945047808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951374.449284:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951374.449507:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923975808 00000100:00100000:0.0:1783951374.449526:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923975808 00000100:00100000:0.0:1783951374.449578:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 62 00000100:00100000:0.0:1783951374.449587:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+15:18809:x1870607923975808:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783951374.449642:0:22778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951374.449671:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa1b8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fca8 expref: 15 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.449711:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e0347f05900) 00010000:00010000:0.0:1783951374.449726:0:22778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951374.449760:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa1c6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.449773:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa1c6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.449783:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa1c6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783951374.450250:0:22778:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000edf8033e reply state 0000000021fbc427 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa1c6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.450263:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b2a00/0x7645c8e1169fa1c6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.450269:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e0347f05900) 00010000:00010000:0.0:1783951374.450271:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783951374.450274:0:22778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783951374.450366:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+16:18809:x1870607923975808:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 779us (1090us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1783951374.450374:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 62 00000100:00100000:3.0:1783951374.454861:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951374.455034:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923975936 00000100:00100000:2.0:1783951374.455043:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923975936 00000100:00100000:2.0:1783951374.455099:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 24 00000100:00100000:2.0:1783951374.455109:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+7:18809:x1870607923975936:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783951374.455128:0:24283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951374.455172:0:24283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edc6cba5/0x7645c8e1169fa1cd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fcb6 expref: -99 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.455206:0:24283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b50ebb6/0x7645c8e1169fa1bf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcaf expref: 8 pid: 24283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.455216:0:24283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951374.455220:0:24283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951374.455227:0:24283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edc6cba5/0x7645c8e1169fa1cd lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcb6 expref: 8 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.455297:0:24283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b50ebb6/0x7645c8e1169fa1bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcaf expref: 8 pid: 24283 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.455312:0:24283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b50ebb6/0x7645c8e1169fa1bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcaf expref: 8 pid: 24283 timeout: 830 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951374.455327:0:24283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24283:1870607945048064:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783951374.455413:0:24283:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d880c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951374.461609:0:24283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24283:1870607945048064:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783951374.461649:0:24283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000edc6cba5/0x7645c8e1169fa1cd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcb6 expref: 8 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.461671:0:24283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e036b4a8600, rc 0) 00000100:00100000:2.0:1783951374.461896:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+8:18809:x1870607923975936:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 6786us (7042us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.461906:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 24 00000100:00100000:3.0:1783951374.464836:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951374.464940:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923976064 00000100:00100000:1.0:1783951374.464950:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923976064 00010000:00010000:1.0:1783951374.465005:0:22764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b50ebb6/0x7645c8e1169fa1bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcaf expref: 8 pid: 24283 timeout: 830 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951374.465071:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:1.0:1783951374.465081:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+8:2408:x1870607923976064:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951374.465097:0:22764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951374.465121:0:22764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b50ebb6/0x7645c8e1169fa1bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcaf expref: 8 pid: 24283 timeout: 830 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.465136:0:22764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b50ebb6/0x7645c8e1169fa1bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcaf expref: 8 pid: 24283 timeout: 830 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.465195:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b50ebb6/0x7645c8e1169fa1bf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcaf expref: 8 pid: 24283 timeout: 830 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.465213:0:22764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951374.465217:0:22764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951374.465225:0:22764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000edc6cba5/0x7645c8e1169fa1cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcb6 expref: 7 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.465235:0:22764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edc6cba5/0x7645c8e1169fa1cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcb6 expref: 7 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.465273:0:22764:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000edc6cba5/0x7645c8e1169fa1cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcb6 expref: 7 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951374.465301:0:22764:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:22764:1870607945048192:192.168.202.33@tcp:105: 00000100:00100000:1.0:1783951374.465380:0:22764:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246b6a780 going to sleep for 11 seconds 00000100:00100000:1.0:1783951374.468963:0:22764:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:22764:1870607945048192:192.168.202.33@tcp:105: 00010000:00010000:1.0:1783951374.468999:0:22764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951374.469062:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+7:2408:x1870607923976064:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 3981us (4243us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951374.469073:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:3.0:1783951374.471246:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951374.474639:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923976192 00000100:00100000:1.0:1783951374.474654:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923976192 00000100:00100000:1.0:1783951374.474730:0:24281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:1.0:1783951374.474742:0:24281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+7:2407:x1870607923976192:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783951374.474896:0:24281:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783951374.474899:0:24281:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1783951374 00002000:00010000:1.0:1783951374.474901:0:24281:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1783951373 00002000:00010000:1.0:1783951374.474902:0:24281:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1783951374 -> 1783951374 00002000:00010000:1.0:1783951374.474904:0:24281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1783951374.474961:0:24281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+8:2407:x1870607923976192:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 Request processed in 221us (3724us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1783951374.474969:0:24281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:3.0:1783951374.479004:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951374.480534:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923976320 00000100:00100000:2.0:1783951374.480548:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923976320 00000100:00100000:2.0:1783951374.480621:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 26 00000100:00100000:2.0:1783951374.480632:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+8:2410:x1870607923976320:12345-192.168.202.33@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783951374.480677:0:24282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a37b21a8/0x7645c8e1169fa1d4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.480719:0:24282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000edc6cba5/0x7645c8e1169fa1cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcb6 expref: 8 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.480729:0:24282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951374.480734:0:24282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783951374.480739:0:24282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a37b21a8/0x7645c8e1169fa1d4 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.480778:0:24282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000edc6cba5/0x7645c8e1169fa1cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcb6 expref: 8 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.480792:0:24282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000edc6cba5/0x7645c8e1169fa1cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcb6 expref: 8 pid: 24283 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951374.480808:0:24282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03811bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24282:1870607945048320:192.168.202.33@tcp:104: 00000100:00100000:2.0:1783951374.481444:0:24282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342d880c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951374.484726:0:24282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03811bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24282:1870607945048320:192.168.202.33@tcp:104: 00010000:00010000:2.0:1783951374.484758:0:24282:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a37b21a8/0x7645c8e1169fa1d4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951374.487672:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951374.488000:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923976448 00000100:00100000:2.0:1783951374.488011:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923976448 00010000:00010000:2.0:1783951374.488055:0:22762:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000edc6cba5/0x7645c8e1169fa1cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcb6 expref: 9 pid: 24283 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951374.488128:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:2.0:1783951374.488139:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+9:2408:x1870607923976448:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951374.488197:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951374.488221:0:22762:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000edc6cba5/0x7645c8e1169fa1cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcb6 expref: 9 pid: 24283 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.488234:0:22762:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000edc6cba5/0x7645c8e1169fa1cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcb6 expref: 9 pid: 24283 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.488269:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edc6cba5/0x7645c8e1169fa1cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcb6 expref: 9 pid: 24283 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.488287:0:22762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783951374.488291:0:22762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783951374.488298:0:22762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a37b21a8/0x7645c8e1169fa1d4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.488309:0:22762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a37b21a8/0x7645c8e1169fa1d4 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.488342:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951374.488395:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+8:2408:x1870607923976448:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 257us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951374.488403:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 20 00010000:00010000:3.0:1783951374.489391:0:24282:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a37b21a8/0x7645c8e1169fa1d4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951374.489406:0:24282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a37b21a8/0x7645c8e1169fa1d4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951374.489446:0:24282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a37b21a8/0x7645c8e1169fa1d4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951374.489455:0:24282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a37b21a8/0x7645c8e1169fa1d4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951374.489463:0:24282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a37b21a8/0x7645c8e1169fa1d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951374.489470:0:24282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e036b4a9800 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:3.0:1783951374.489474:0:24282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a37b21a8/0x7645c8e1169fa1d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951374.489484:0:24282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a37b21a8/0x7645c8e1169fa1d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951374.489499:0:24282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a37b21a8/0x7645c8e1169fa1d4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951374.489507:0:24282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a37b21a8/0x7645c8e1169fa1d4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951374.489602:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+7:2410:x1870607923976320:12345-192.168.202.33@tcp:1:lhsmtool_posix.0 Request processed in 8968us (10604us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951374.489619:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 26 00000100:00100000:3.0:1783951374.494608:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951374.494757:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923976704 00000100:00100000:1.0:1783951374.494767:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923976704 00000100:00100000:1.0:1783951374.494841:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 63 00000100:00100000:1.0:1783951374.494852:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+16:18809:x1870607923976704:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783951374.494953:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa1db lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.494985:0:22777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa125 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc77 expref: 16 pid: 25821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.494996:0:22777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa1db lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.495033:0:22777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa125 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc77 expref: 16 pid: 25821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.495047:0:22777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa125 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc77 expref: 16 pid: 25821 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951374.495062:0:22777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22777:1870607945048448:192.168.202.33@tcp:104: 00000100:00100000:1.0:1783951374.495190:0:22777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246b6a780 going to sleep for 11 seconds 00000100:00100000:3.0:1783951374.503452:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951374.503564:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923976832 00000100:00100000:0.0:1783951374.503572:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923976832 00010000:00010000:0.0:1783951374.503613:0:22764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa125 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc77 expref: 17 pid: 25821 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951374.503659:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:0.0:1783951374.503684:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+17:2407:x1870607923976832:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783951374.503701:0:22764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951374.503708:0:22764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa125 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc77 expref: 17 pid: 25821 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.503721:0:22764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa125 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc77 expref: 17 pid: 25821 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.503745:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:0.0:1783951374.503751:0:22764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169fa141 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc85 expref: 17 pid: 25821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.503761:0:22764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa1db lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.503769:0:22764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa1db lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.503776:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa1db lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.503795:0:22764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951374.503858:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+17:2407:x1870607923976832:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 176us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951374.503866:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 21 00010000:00010000:1.0:1783951374.504888:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67800/0x7645c8e1169fa125 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc77 expref: 16 pid: 25821 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951374.504909:0:22777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22777:1870607945048448:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951374.504931:0:22777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa1db lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.504941:0:22777:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa1db lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.504947:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa1db lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.505215:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa1e2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.505228:0:22777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66000/0x7645c8e1169fa1aa lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fca1 expref: 16 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.505236:0:22777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa1e2 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.505271:0:22777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66000/0x7645c8e1169fa1aa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fca1 expref: 16 pid: 22777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.505287:0:22777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66000/0x7645c8e1169fa1aa lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fca1 expref: 16 pid: 22777 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951374.505300:0:22777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22777:1870607945048576:192.168.202.33@tcp:104: 00000100:00100000:1.0:1783951374.505370:0:22777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0342972cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951374.508322:0:22777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22777:1870607945048576:192.168.202.33@tcp:104: 00010000:00010000:1.0:1783951374.508349:0:22777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa1e2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951374.510269:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1783951374.510420:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923976960 00000100:00100000:1.0:1783951374.510429:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923976960 00010000:00010000:1.0:1783951374.510465:0:22763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66000/0x7645c8e1169fa1aa lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fca1 expref: 17 pid: 22777 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951374.510491:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:1.0:1783951374.510510:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e034121ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+17:2409:x1870607923976960:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951374.510524:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951374.510529:0:22763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66000/0x7645c8e1169fa1aa lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fca1 expref: 17 pid: 22777 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.510537:0:22763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66000/0x7645c8e1169fa1aa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fca1 expref: 17 pid: 22777 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.510553:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66000/0x7645c8e1169fa1aa lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fca1 expref: 17 pid: 22777 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.510565:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e0347f05900) 00010000:00010000:1.0:1783951374.510569:0:22763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa1e2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.510577:0:22763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa1e2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.510582:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa1e2 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.510601:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951374.510637:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e034121ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+16:2409:x1870607923976960:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 127us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951374.510641:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 22 00010000:00010000:3.0:1783951374.510845:0:22777:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa1e2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951374.510851:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa1e2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783951374.510949:0:22777:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:3.0:1783951374.511080:0:22777:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:3.0:1783951374.511119:0:22777:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:3.0:1783951374.511217:0:22777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e036aed1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22777:1870607945048704:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783951374.511655:0:22777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951374.511731:0:22777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e0246b6a780 going to sleep for 11 seconds 00000100:00100000:1.0:1783951374.511771:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945048704 00000100:00100000:1.0:1783951374.511777:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945048704 00000100:00100000:1.0:1783951374.512041:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783951374.512049:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22777:x1870607945048704:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783951374.512132:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22777:x1870607945048704:12345-0@lo:1000:mdt00_001.0 Request processed in 83us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951374.512157:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783951374.512203:0:22777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e036aed1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22777:1870607945048704:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1783951374.512380:0:22777:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1783951374.512426:0:22777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e0341218a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22777:1870607945048832:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783951374.512459:0:22777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951374.512489:0:22777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037cb1be40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951374.512492:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945048832 00000100:00100000:3.0:1783951374.512496:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945048832 00000100:00100000:3.0:1783951374.512527:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783951374.512535:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0341219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22777:x1870607945048832:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783951374.512660:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0341219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22777:x1870607945048832:12345-0@lo:1000:mdt00_001.0 Request processed in 126us (199us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1783951374.512665:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783951374.512856:0:22777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e0341218a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22777:1870607945048832:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1783951374.512888:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa1e2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.512895:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa1e2 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.512900:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa1e2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.512904:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67000 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951374.512907:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa1e2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.512912:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa1e2 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.512921:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e0347f05900) 00010000:00010000:0.0:1783951374.512923:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783951374.512926:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa1e2 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.512930:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67000/0x7645c8e1169fa1e2 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.512951:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa13a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.512955:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa13a lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.513003:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa13a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.513011:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a67600 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951374.513015:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa13a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.513022:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa13a lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.513030:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:0.0:1783951374.513032:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783951374.513036:0:22777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169fa141 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc85 expref: 19 pid: 25821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.513044:0:22777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169fa141 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc85 expref: 19 pid: 25821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.513049:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169fa141 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc85 expref: 19 pid: 25821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.513089:0:22777:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66800/0x7645c8e1169fa141 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fc85 expref: 19 pid: 25821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951374.513095:0:22777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22777:1870607945048960:192.168.202.33@tcp:105: 00000100:00100000:0.0:1783951374.513337:0:22777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e037cb1be40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951374.515215:0:22777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22777:1870607945048960:192.168.202.33@tcp:105: 00010000:00010000:3.0:1783951374.515243:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa13a lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951374.515251:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a67600/0x7645c8e1169fa13a lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951374.515725:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00010000:00010000:0.0:1783951374.515786:0:22777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1e9 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.515811:0:22777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1e9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.515823:0:22777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1e9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.515833:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1e9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.515840:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1e9 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.515847:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1e9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.515853:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b3c00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951374.515857:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1e9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.515864:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1e9 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.515874:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:0.0:1783951374.515878:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951374.515880:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1e9 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.515886:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1e9 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.515895:0:22777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa1db lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.515906:0:22777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa1db lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.515913:0:22777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa1db lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.515917:0:22777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0247a66a00 already unused, calling callback (ffffffffc1a6b4f0) 00010000:00010000:0.0:1783951374.515921:0:22777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa1db lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.515926:0:22777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa1db lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.515935:0:22777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:0.0:1783951374.515937:0:22777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783951374.515940:0:22777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa1db lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.515946:0:22777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0247a66a00/0x7645c8e1169fa1db lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951374.516134:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+19:18809:x1870607923976704:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 21283us (21533us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1783951374.516161:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 63 00000020:00080000:0.0:1783951374.516166:0:22777:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1783951374.516264:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923977088 00000100:00100000:3.0:1783951374.516273:0:22779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923977088 00000100:00100000:3.0:1783951374.516320:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00100000:3.0:1783951374.516326:0:22779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037ebd0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+19:18808:x1870607923977088:12345-192.168.202.33@tcp:49:dd.0 00000100:00100000:3.0:1783951374.516399:0:22779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037ebd0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+19:18808:x1870607923977088:12345-192.168.202.33@tcp:49:dd.0 Request processed in 74us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951374.516404:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 10 00000040:00080000:1.0:1783951374.516548:0:22812:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1783951374.516552:0:22812:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783951374.516563:0:22812:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1783951374.516569:0:22812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1783951374.519072:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1783951374.519176:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923977216 00000100:00100000:2.0:1783951374.519184:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923977216 00000100:00100000:2.0:1783951374.519238:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 64 00000100:00100000:2.0:1783951374.519247:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+19:18808:x1870607923977216:12345-192.168.202.33@tcp:101:dd.0 00010000:00010000:2.0:1783951374.519273:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951374.519293:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8a00/0x7645c8e1169fa1f0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xecf17d71e9c3fcbd expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.519325:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa1f7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.519337:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa1f7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.519347:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa1f7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.519664:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8a00/0x7645c8e1169fa1f0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcbd expref: 21 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.519677:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e036b4a8c00/0x7645c8e1169fa1f7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0xecf17d71e9c3fcbd expref: 20 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.519688:0:22778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e03427e5300) 00010000:00010000:0.0:1783951374.519690:0:22778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783951374.519692:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e036b4a8c00, rc 0) 00000100:00100000:0.0:1783951374.519749:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+20:18808:x1870607923977216:12345-192.168.202.33@tcp:101:dd.0 Request processed in 503us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951374.519756:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 64 00000100:00100000:2.0:1783951374.529465:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951374.532234:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923977472 00000100:00100000:0.0:1783951374.532248:0:22779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923977472 00000100:00100000:0.0:1783951374.532455:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:0.0:1783951374.532467:0:22779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+20:18809:x1870607923977472:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783951374.532728:0:22779:0:(mdd_object.c:4016:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783951374.532765:0:22779:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:0.0:1783951374.532800:0:22779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1fe lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.532816:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1fe lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.532829:0:22779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1fe lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.532837:0:22779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1fe lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.532843:0:22779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1fe lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.532849:0:22779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1fe lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.532892:0:22779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951374.533136:0:22765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951374.533164:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1fe lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.533172:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b3c00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:1.0:1783951374.533176:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1fe lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.533184:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1fe lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.533196:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e0347f05900) 00010000:00010000:1.0:1783951374.533199:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783951374.533203:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1fe lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.533209:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e037d2b3c00/0x7645c8e1169fa1fe lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951374.533221:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951374.533223:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951374.533224:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951374.533459:0:22779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+22:18809:x1870607923977472:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 992us (4002us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1783951374.533469:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 11 00000020:00080000:0.0:1783951374.533475:0:22779:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783951374.555823:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1783951374.555867:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1783951374.556196:0:24287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923977600 00000100:00100000:0.0:1783951374.556207:0:24287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923977600 00000100:00100000:0.0:1783951374.556265:0:24287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607923977728 00000100:00100000:0.0:1783951374.556268:0:24287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607923977728 00000100:00100000:0.0:1783951374.556287:0:24287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:0.0:1783951374.556298:0:24287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+8:2407:x1870607923977600:12345-192.168.202.33@tcp:4:dd.0 00002000:00010000:0.0:1783951374.556350:0:24287:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a54f00e, atime: 0x6a54f00d, ctime: 0x6a54f00e, blocks: 0x0 00010000:00010000:0.0:1783951374.556360:0:24287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5420bf8/0x7645c8e1169fa205 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.556378:0:24287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=730s v=(0 0) 00010000:00010000:0.0:1783951374.556382:0:24287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951374.556388:0:24287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5420bf8/0x7645c8e1169fa205 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.556402:0:24287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5420bf8/0x7645c8e1169fa205 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783951374.635957:0:24277:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:2.0:1783951374.635993:0:24277:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:0.0:1783951374.636281:0:24287:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1783951374.636286:0:24287:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1783951374.636301:0:24287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5420bf8/0x7645c8e1169fa205 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.636324:0:24287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5420bf8/0x7645c8e1169fa205 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.636331:0:24287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5420bf8/0x7645c8e1169fa205 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.636336:0:24287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2200 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:0.0:1783951374.636339:0:24287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5420bf8/0x7645c8e1169fa205 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.636345:0:24287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5420bf8/0x7645c8e1169fa205 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.636360:0:24287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5420bf8/0x7645c8e1169fa205 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.636364:0:24287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5420bf8/0x7645c8e1169fa205 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951374.636458:0:24287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+6:2407:x1870607923977600:12345-192.168.202.33@tcp:4:dd.0 Request processed in 80157us (80645us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1783951374.636469:0:24287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:0.0:1783951374.636504:0:24287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 1 00000100:00100000:0.0:1783951374.636514:0:24287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+5:2408:x1870607923977728:12345-192.168.202.33@tcp:4:dd.0 00002000:00010000:0.0:1783951374.637049:0:24287:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 4194304, mtime: 0x6a54f00e, atime: 0x6a54f00d, ctime: 0x6a54f00e, blocks: 0x2000 00010000:00010000:0.0:1783951374.637063:0:24287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000253980ca/0x7645c8e1169fa20c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.637076:0:24287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=730s v=(0 0) 00010000:00010000:0.0:1783951374.637081:0:24287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951374.637087:0:24287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000253980ca/0x7645c8e1169fa20c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951374.637098:0:24287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000253980ca/0x7645c8e1169fa20c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783951374.717018:0:24277:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:2.0:1783951374.717272:0:24287:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1783951374.717279:0:24287:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1783951374.717297:0:24287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000253980ca/0x7645c8e1169fa20c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.717309:0:24287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000253980ca/0x7645c8e1169fa20c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.717332:0:24287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000253980ca/0x7645c8e1169fa20c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.717338:0:24287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e037d2b2e00 already unused, calling callback (ffffffffc0e70230) 00010000:00010000:2.0:1783951374.717343:0:24287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000253980ca/0x7645c8e1169fa20c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.717351:0:24287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000253980ca/0x7645c8e1169fa20c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.717370:0:24287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000253980ca/0x7645c8e1169fa20c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951374.717377:0:24287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000253980ca/0x7645c8e1169fa20c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951374.717552:0:24287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a3b69357-ecfd-411d-bcaf-eec1ed5aa77c+5:2408:x1870607923977728:12345-192.168.202.33@tcp:4:dd.0 Request processed in 81035us (161679us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1783951374.717568:0:24287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 1 00010000:00010000:0.0:1783951374.880459:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951375.904613:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783951376.420045:0:25858:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1783951376.930266:0:22766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951376.992669:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951376.999651:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945049088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951376.999733:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951376.999907:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945049088 00000100:00100000:1.0:1783951376.999916:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945049088 00000100:00100000:1.0:1783951376.999996:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783951377.000008:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e03811b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945049088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783951377.000064:0:24284:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00080000:3.0:1783951377.000391:0:22773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951377.006256:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e03811b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1870607945049088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6240us (6511us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951377.006272:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783951377.006444:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3653:1870607945049088:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783951377.952382:0:22765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951378.016420:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e037e425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607945049216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951378.016490:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951378.016901:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945049216 00000100:00100000:1.0:1783951378.016909:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945049216 00000100:00100000:1.0:1783951378.016970:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783951378.016982:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e037e424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607945049216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783951378.017019:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783951378.017083:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e037e424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1870607945049216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951378.017091:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783951378.017198:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e037e425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3653:1870607945049216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951378.017355:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e03489c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945049344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783951378.017390:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951378.017556:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870607945049344 00000100:00100000:1.0:1783951378.017560:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870607945049344 00000100:00100000:1.0:1783951378.017591:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783951378.017598:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e036aed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945049344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783951378.017618:0:22782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1783951378.017656:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e036aed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1870607945049344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951378.017662:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783951378.017691:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e03489c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3654:1870607945049344:0@lo:41:osp-pre-0-1.0 Debug log: 14016 lines, 14016 kept, 0 dropped, 0 bad.