00010000:00010000:3.0F:1788612776.885272:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1788612776.944048:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932350848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612776.944128:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612776.944210:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932350848 00000100:00100000:1.0:1788612776.944218:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932350848 00000100:00080000:3.0:1788612776.944252:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612776.944278:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788612776.944289:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932350848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788612776.944321:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788612776.944368:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932350848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612776.944375:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788612776.944431:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932350848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612776.944853:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8f80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932351104:0@lo:400:kworker.0 00000100:00100000:3.0:1788612776.944892:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612776.944936:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932351616:0@lo:400:kworker.0 00000100:00100000:1.0:1788612776.945287:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8f82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d240c1fb-ce1c-496f-9994-daecd37f5c24:3650:1875495932350976:0@lo:400:kworker.0 00000100:00100000:1.0:1788612776.945323:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612776.945352:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932351488:0@lo:400:kworker.0 00000100:00100000:1.0:1788612776.945378:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612776.945402:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932352000:0@lo:400:kworker.0 00000100:00100000:3.0:1788612776.945409:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612776.945436:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612776.945438:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8f83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932352128:0@lo:400:kworker.0 00000100:00100000:3.0:1788612776.945470:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612776.945504:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932351104 00000100:00100000:1.0:1788612776.945512:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932351104 00000100:00100000:3.0:1788612776.945530:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932351616 00000100:00100000:3.0:1788612776.945536:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932351616 00000100:00100000:1.0:1788612776.945554:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788612776.945565:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932351104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612776.945571:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788612776.945581:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932351616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612776.945625:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932351104:12345-0@lo:400:kworker.0 Request processed in 62us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612776.945633:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932351616:12345-0@lo:400:kworker.0 Request processed in 52us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612776.945638:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788612776.945647:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788612776.945666:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932350976 00000100:00100000:1.0:1788612776.945671:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932350976 00000100:00100000:1.0:1788612776.945717:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788612776.945725:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:3650:x1875495932350976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612776.945729:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932351488 00000100:00100000:3.0:1788612776.945735:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932351488 00000100:00100000:1.0:1788612776.945765:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:3650:x1875495932350976:12345-0@lo:400:kworker.0 Request processed in 41us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612776.945770:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932352000 00000100:00100000:1.0:1788612776.945773:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788612776.945775:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932352000 00000100:00100000:1.0:1788612776.945805:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932352128 00000100:00100000:1.0:1788612776.945810:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932352128 00000100:00100000:0.0F:1788612776.945915:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788612776.945940:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932351488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612776.945976:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932351488:12345-0@lo:400:kworker.0 Request processed in 38us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612776.945982:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788612776.946005:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932351232:0@lo:400:kworker.0 00000100:00100000:3.0:1788612776.946226:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788612776.946234:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932352000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612776.946399:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932352000:12345-0@lo:400:kworker.0 Request processed in 165us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612776.946406:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788612776.946456:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8f82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d240c1fb-ce1c-496f-9994-daecd37f5c24:3650:1875495932350976:0@lo:400:kworker.0 00000100:00100000:3.0:1788612776.946470:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932351488:0@lo:400:kworker.0 00000100:00100000:3.0:1788612776.946504:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932352000:0@lo:400:kworker.0 00000100:00100000:3.0:1788612776.946554:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8f80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932351104:0@lo:400:kworker.0 00000100:00100000:3.0:1788612776.946564:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932351616:0@lo:400:kworker.0 00000100:00100000:3.0:1788612776.946642:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8f80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932351360:0@lo:400:kworker.0 00000100:00100000:3.0:1788612776.946673:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612776.946699:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932351872:0@lo:400:kworker.0 00000100:00100000:3.0:1788612776.946721:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612776.946736:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932352384:0@lo:400:kworker.0 00000100:00100000:3.0:1788612776.946755:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612776.946779:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932351872 00000100:00100000:3.0:1788612776.946783:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932351872 00000100:00100000:3.0:1788612776.946821:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932352384 00000100:00100000:3.0:1788612776.946824:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932352384 00000100:00100000:0.0:1788612776.948909:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612776.948963:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8f81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932351744:0@lo:400:kworker.0 00000100:00100000:0.0:1788612776.949015:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612776.949048:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932352256:0@lo:400:kworker.0 00000100:00100000:0.0:1788612776.949073:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612776.949115:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932351360 00000100:00100000:0.0:1788612776.949122:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932351360 00000100:00100000:1.0:1788612776.949309:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932352256 00000100:00100000:1.0:1788612776.949314:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932352256 00000100:00100000:1.0:1788612776.949335:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788612776.949344:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932351872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612776.949403:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932351872:12345-0@lo:400:kworker.0 Request processed in 60us (2680us total) trans 0 rc 0/0 00000100:00080000:2.0F:1788612776.949416:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612776.949434:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612776.949436:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612776.949450:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932351232 00000100:00100000:2.0:1788612776.949454:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932351232 00000100:00100000:2.0:1788612776.949501:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932351744 00000100:00100000:2.0:1788612776.949505:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932351744 00000100:00100000:2.0:1788612776.949521:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788612776.949527:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932351232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612776.949549:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788612776.949572:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788612776.949575:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932351232:12345-0@lo:400:kworker.0 Request processed in 44us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612776.949583:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8f81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932352128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612776.949586:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788612776.949607:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788612776.949616:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932351744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612776.949633:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8f81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932352128:12345-0@lo:400:kworker.0 Request processed in 52us (4162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612776.949640:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788612776.949658:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932351744:12345-0@lo:400:kworker.0 Request processed in 42us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612776.949659:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788612776.949672:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788612776.949673:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932352256:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788612776.949705:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612776.949710:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932352256:12345-0@lo:400:kworker.0 Request processed in 42us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612776.949715:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788612776.949764:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932351872:0@lo:400:kworker.0 00010000:00080000:2.0:1788612776.949879:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c8f83480 x1875495932352128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612776.949890:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8f83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932352128:0@lo:400:kworker.0 00000100:00100000:2.0:1788612776.949903:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788612776.949911:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932352512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612776.949942:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612776.950105:0:20368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932352512 00000100:00100000:2.0:1788612776.950110:0:20368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932352512 00000100:00100000:2.0:1788612776.950136:0:20368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612776.950150:0:20368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875495932352512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788612776.950176:0:20368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788612776.950211:0:20368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875495932352512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612776.950218:0:20368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612776.950248:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932352512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612776.951762:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932351232:0@lo:400:kworker.0 00000100:00100000:2.0:1788612776.951779:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8f81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932351744:0@lo:400:kworker.0 00000100:00100000:2.0:1788612776.951856:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932352256:0@lo:400:kworker.0 00000100:00100000:3.0:1788612776.952310:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788612776.952321:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932352384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612776.952395:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875495932352384:12345-0@lo:400:kworker.0 Request processed in 76us (5638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612776.952402:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1788612776.952445:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c8f83b80 x1875495932352384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612776.952456:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932352384:0@lo:400:kworker.0 00000100:00100000:0.0:1788612776.952668:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788612776.952677:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932351360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612776.952721:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932351360:12345-0@lo:400:kworker.0 Request processed in 46us (6048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612776.952729:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788612776.952759:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8f80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932351360:0@lo:400:kworker.0 00010000:00010000:0.0:1788612777.909776:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788612778.482716:0:17178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:3.0:1788612778.482735:0:17178:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9612c6cf5480 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:3.0:1788612778.482741:0:17178:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9612fcd91f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9612c6cf5f00 00000020:00080000:3.0:1788612778.482744:0:17178:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9612fcd91e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9613002cce00 00000020:00080000:0.0:1788612778.482775:0:17238:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00010000:00010000:1.0:1788612778.482819:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0000/0x1f8616bf0bc98d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788612778.482839:0:17238:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788612778.482842:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0000/0x1f8616bf0bc98d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612778.482852:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0000/0x1f8616bf0bc98d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612778.482858:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d0000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612778.482863:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0000/0x1f8616bf0bc98d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612778.482871:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0000/0x1f8616bf0bc98d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612778.482889:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9612c93f7100) 00010000:00010000:1.0:1788612778.482892:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612778.482898:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0000/0x1f8616bf0bc98d3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612778.482904:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0000/0x1f8616bf0bc98d3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612778.593189:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612778.593275:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612778.593309:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612778.593431:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612778.593455:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612778.593473:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612778.593519:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914449024 00000100:00100000:3.0:1788612778.593529:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914449024 00000100:00100000:3.0:1788612778.593660:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914449536 00000100:00100000:3.0:1788612778.593664:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914449536 00000100:00100000:3.0:1788612778.593689:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:3.0:1788612778.593698:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+13:2395:x1875495914449024:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612778.593769:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+13:2395:x1875495914449024:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 71us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612778.593778:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:3.0:1788612778.593796:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:3.0:1788612778.593802:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:2395:x1875495914449536:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612778.593828:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:2395:x1875495914449536:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612778.593834:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00080000:3.0:1788612778.593852:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612778.593987:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612778.594067:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612778.594456:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612778.594705:0:19152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914449280 00000100:00100000:1.0:1788612778.594711:0:19152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914449280 00000100:00100000:1.0:1788612778.594745:0:19152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914449792 00000100:00100000:1.0:1788612778.594748:0:19152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914449792 00000100:00100000:1.0:1788612778.594758:0:19152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914449408 00000100:00100000:1.0:1788612778.594760:0:19152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914449408 00000100:00100000:1.0:1788612778.594771:0:19152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914449920 00000100:00100000:1.0:1788612778.594773:0:19152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914449920 00000100:00100000:1.0:1788612778.594786:0:19152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:1.0:1788612778.594794:0:19152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2395:x1875495914449280:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612778.594837:0:19152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2395:x1875495914449280:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 43us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612778.594844:0:19152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:1.0:1788612778.594858:0:19152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:1.0:1788612778.594864:0:19152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2395:x1875495914449792:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612778.594888:0:19152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2395:x1875495914449792:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612778.594893:0:19152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:1.0:1788612778.594903:0:19152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:1.0:1788612778.594909:0:19152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2395:x1875495914449408:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612778.594928:0:19152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2395:x1875495914449408:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 19us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612778.594934:0:19152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:1.0:1788612778.594944:0:19152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:1.0:1788612778.594949:0:19152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2395:x1875495914449920:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612778.594982:0:19152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2395:x1875495914449920:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 32us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612778.594995:0:19152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:3.0:1788612778.595178:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914449152 00000100:00100000:3.0:1788612778.595182:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914449152 00000100:00100000:3.0:1788612778.595210:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914449664 00000100:00100000:3.0:1788612778.595213:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914449664 00000100:00100000:3.0:1788612778.595230:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:3.0:1788612778.595235:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2395:x1875495914449152:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612778.595262:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2395:x1875495914449152:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (1788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612778.595269:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:3.0:1788612778.595280:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:3.0:1788612778.595286:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2395:x1875495914449664:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612778.595318:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2395:x1875495914449664:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 32us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612778.595325:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:1.0:1788612778.595767:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914448896 00000100:00100000:1.0:1788612778.595773:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914448896 00000100:00100000:1.0:1788612778.595845:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 167 00000100:00100000:1.0:1788612778.595853:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+13:2395:x1875495914448896:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612778.595880:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+13:2395:x1875495914448896:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (2424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612778.595886:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 167 00000100:00080000:1.0:1788612778.596746:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788612778.596752:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612778.596755:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788612778.927795:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612779.113704:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612779.117208:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914450048 00000100:00100000:3.0:1788612779.117225:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914450048 00000100:00100000:3.0:1788612779.117337:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:3.0:1788612779.117350:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+13:15581:x1875495914450048:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788612779.117472:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+13:15581:x1875495914450048:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 125us (3777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612779.117499:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:0.0:1788612779.123935:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612779.123998:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914450176 00000100:00100000:0.0:1788612779.124006:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914450176 00000100:00100000:0.0:1788612779.124055:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:0.0:1788612779.124075:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:15581:x1875495914450176:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788612779.124181:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:15581:x1875495914450176:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 107us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612779.124188:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:0.0:1788612779.130333:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612779.130382:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914450432 00000100:00100000:3.0:1788612779.130392:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914450432 00000100:00100000:3.0:1788612779.130449:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:3.0:1788612779.130460:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+13:15581:x1875495914450432:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788612779.131289:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+14:15581:x1875495914450432:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 827us (961us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788612779.131299:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00010000:00010000:0.0:1788612779.951719:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612780.015927:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932352640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612780.015993:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612780.016074:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932352640 00000100:00100000:2.0:1788612780.016082:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932352640 00000100:00100000:2.0:1788612780.016131:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788612780.016142:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932352640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788612780.016181:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788612780.016222:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932352640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612780.016229:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788612780.016276:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932352640:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788612780.016772:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612780.017683:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612780.017706:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612e901c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932352768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612780.017757:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612780.017970:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932352768 00000100:00100000:3.0:1788612780.017977:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932352768 00000100:00100000:3.0:1788612780.018044:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788612780.018052:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932352768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788612780.018070:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788612780.018116:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932352768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612780.018138:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788612780.018189:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612e901c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932352768:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788612780.018329:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612780.019440:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612780.019455:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932352896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612780.019527:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612780.019622:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932352896 00000100:00100000:1.0:1788612780.019629:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932352896 00000100:00100000:1.0:1788612780.019679:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788612780.019688:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932352896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788612780.019719:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788612780.019774:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932352896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612780.019780:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788612780.019929:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932352896:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788612780.208213:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788612780.527937:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612e901c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932353024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612780.528010:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612780.528131:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932353024 00000100:00100000:2.0:1788612780.528139:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932353024 00000100:00100000:2.0:1788612780.528207:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788612780.528217:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932353024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788612780.528249:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788612780.528314:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932353024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612780.528321:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788612780.528360:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612e901c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932353024:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788612780.975791:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612781.999748:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612782.063730:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612e901c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932353152:0@lo:400:kworker.0 00000100:00100000:2.0:1788612782.063795:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612782.067418:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788612782.067447:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932353408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612782.067528:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612782.067588:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932353280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612782.067617:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612782.067642:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932353664:0@lo:400:kworker.0 00000100:00100000:1.0:1788612782.067675:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612782.067693:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932353792:0@lo:400:kworker.0 00000100:00100000:1.0:1788612782.067697:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932354176:0@lo:400:kworker.0 00000100:00100000:3.0:1788612782.067723:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932353408 00000100:00100000:3.0:1788612782.067732:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932353408 00000100:00100000:1.0:1788612782.067745:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612782.067745:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612782.067770:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932354688:0@lo:400:kworker.0 00000100:00100000:0.0:1788612782.067779:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932354304:0@lo:400:kworker.0 00000100:00100000:3.0:1788612782.067784:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932353280 00000100:00100000:3.0:1788612782.067788:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932353280 00000100:00100000:1.0:1788612782.067794:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612782.067810:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788612782.067819:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612782.067822:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932353408:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612782.067828:0:19152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932353664 00000100:00100000:1.0:1788612782.067832:0:19152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932353664 00000100:00100000:0.0:1788612782.067843:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932354816:0@lo:400:kworker.0 00002000:00000024:3.0:1788612782.067855:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788612782.067872:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612782.067907:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932353792 00000100:00100000:0.0:1788612782.067912:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932353792 00000100:00100000:3.0:1788612782.067913:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932353408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612782.067922:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788612782.067938:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932354688 00000100:00100000:0.0:1788612782.067942:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932354688 00000100:00100000:3.0:1788612782.067945:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788612782.067954:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932353280:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612782.067962:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932354304 00002000:00000024:3.0:1788612782.067965:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788612782.067966:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932354304 00000100:00100000:0.0:1788612782.067980:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932354816 00000100:00100000:0.0:1788612782.067984:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932354816 00000100:00100000:3.0:1788612782.067998:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932353280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612782.068003:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788612782.068008:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788612782.068013:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932353792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612782.068067:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932353792:12345-0@lo:400:kworker.0 Request processed in 55us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612782.068074:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788612782.068089:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788612782.068096:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932354688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612782.068294:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932354688:12345-0@lo:400:kworker.0 Request processed in 198us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612782.068301:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788612782.068314:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788612782.068320:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc73b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932354304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612782.068346:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc73b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932354304:12345-0@lo:400:kworker.0 Request processed in 27us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612782.068351:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788612782.068362:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788612782.068367:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932354816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612782.068392:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932354816:12345-0@lo:400:kworker.0 Request processed in 25us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612782.068397:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788612782.068643:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932353536:0@lo:400:kworker.0 00000100:00100000:0.0:1788612782.068677:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612782.069677:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932354688:0@lo:400:kworker.0 00000100:00100000:3.0:1788612782.069700:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932353408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612782.069713:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932353280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612782.069748:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932354176 00000100:00100000:3.0:1788612782.069767:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932354176 00000100:00100000:3.0:1788612782.069804:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788612782.069811:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932353664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612782.069872:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932353664:12345-0@lo:400:kworker.0 Request processed in 62us (2198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612782.069879:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788612782.069892:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788612782.069898:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932354176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612782.069925:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932354176:12345-0@lo:400:kworker.0 Request processed in 28us (2184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612782.069931:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788612782.069946:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788612782.069951:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788612782.069954:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788612782.069957:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612782.069976:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932353664:0@lo:400:kworker.0 00000100:00100000:3.0:1788612782.069985:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932354176:0@lo:400:kworker.0 00000100:00100000:3.0:1788612782.070020:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932353536 00000100:00100000:3.0:1788612782.070024:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932353536 00000100:00100000:3.0:1788612782.070055:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788612782.070061:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc73b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932353536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612782.070096:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc73b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932353536:12345-0@lo:400:kworker.0 Request processed in 34us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612782.070102:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788612782.070141:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932353792:0@lo:400:kworker.0 00000100:00100000:3.0:1788612782.070154:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932354304:0@lo:400:kworker.0 00010000:00080000:3.0:1788612782.070178:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fc739f80 x1875495932354816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612782.070188:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932354816:0@lo:400:kworker.0 00000100:00100000:0.0:1788612782.070633:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932353536:0@lo:400:kworker.0 00000100:00100000:0.0:1788612782.070645:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932354048:0@lo:400:kworker.0 00000100:00100000:0.0:1788612782.070681:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612782.070702:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc73a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932354560:0@lo:400:kworker.0 00000100:00100000:0.0:1788612782.070736:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612782.070763:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788612782.070769:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932353920:0@lo:400:kworker.0 00000100:00100000:0.0:1788612782.070793:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612782.070813:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc73bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932354432:0@lo:400:kworker.0 00000100:00100000:0.0:1788612782.070832:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612782.071062:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932354560 00000100:00100000:2.0:1788612782.071067:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932354560 00000100:00100000:2.0:1788612782.071106:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932354432 00000100:00100000:2.0:1788612782.071109:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932354432 00000100:00100000:2.0:1788612782.071145:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788612782.071153:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932354560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612782.071188:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932354560:12345-0@lo:400:kworker.0 Request processed in 37us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612782.071194:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788612782.071207:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788612782.071212:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc73aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932354432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612782.071236:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc73aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932354432:12345-0@lo:400:kworker.0 Request processed in 24us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612782.071242:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1788612782.071257:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612782.071260:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788612782.071280:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932353920 00000100:00100000:2.0:1788612782.071284:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932353920 00000100:00100000:2.0:1788612782.071304:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788612782.071317:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932353920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612782.071348:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932353920:12345-0@lo:400:kworker.0 Request processed in 32us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612782.071353:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788612782.072736:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932353920:0@lo:400:kworker.0 00000100:00100000:0.0:1788612782.072753:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc73bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932354432:0@lo:400:kworker.0 00010000:00080000:0.0:1788612782.072766:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fc73a300 x1875495932354560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612782.072775:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc73a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932354560:0@lo:400:kworker.0 00000100:00100000:3.0:1788612782.073580:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932353152 00000100:00100000:3.0:1788612782.073589:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932353152 00000100:00100000:3.0:1788612782.073700:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788612782.073713:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:3648:x1875495932353152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612782.073788:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:3648:x1875495932353152:12345-0@lo:400:kworker.0 Request processed in 79us (9992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612782.073795:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788612782.074005:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612e901c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932353152:0@lo:400:kworker.0 00000100:00100000:2.0:1788612782.074046:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932354048 00000100:00100000:2.0:1788612782.074050:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932354048 00000100:00100000:2.0:1788612782.074086:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788612782.074092:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932354048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612782.074144:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932354048:12345-0@lo:400:kworker.0 Request processed in 52us (3463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612782.074151:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788612782.074167:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612782.074204:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932354048:0@lo:400:kworker.0 00000001:02000400:3.0:1788612782.924599:0:20572:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 08:53:01 (1788612781) 00010000:00010000:3.0:1788612783.023709:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612783.705691:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612783.705729:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612783.705887:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914450816 00000100:00100000:2.0:1788612783.705898:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914450816 00000100:00100000:3.0:1788612783.705901:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612783.705951:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612783.705965:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914450688 00000100:00100000:2.0:1788612783.705970:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914450688 00000100:00100000:3.0:1788612783.705982:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914450944 00000100:00100000:3.0:1788612783.705988:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914450944 00000100:00100000:2.0:1788612783.706000:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:2.0:1788612783.706012:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2395:x1875495914450816:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612783.706027:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:3.0:1788612783.706038:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2395:x1875495914450944:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612783.706334:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2395:x1875495914450944:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 297us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612783.706343:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:3.0:1788612783.706388:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:3.0:1788612783.706396:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+14:2395:x1875495914450688:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612783.706436:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a43cb079-defd-42bd-a3d5-1be09fd1336b+14:2395:x1875495914450688:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 42us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612783.706443:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00080000:3.0:1788612783.706463:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788612783.706467:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788612783.706469:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788612783.706717:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2395:x1875495914450816:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 80us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612783.706725:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:1.0:1788612783.706942:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914450560 00000100:00100000:1.0:1788612783.706948:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914450560 00000100:00100000:1.0:1788612783.706989:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 169 00000100:00100000:1.0:1788612783.706996:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ec084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+13:2395:x1875495914450560:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612783.707023:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ec084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+13:2395:x1875495914450560:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612783.707029:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 169 00000100:00100000:3.0:1788612783.715409:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612783.715453:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612783.715536:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914451072 00000100:00100000:2.0:1788612783.715546:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914451072 00000100:00100000:2.0:1788612783.715628:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:2.0:1788612783.715648:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2393:x1875495914451072:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:2.0:1788612783.715678:0:18704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9602 00000100:00100000:1.0:1788612783.715686:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914451328 00000100:00100000:1.0:1788612783.715692:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914451328 00000100:00080000:2.0:1788612783.715696:0:18704:0:(import.c:65:import_set_state_nolock()) ffff9612d1e70000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788612783.715735:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:1.0:1788612783.715743:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2394:x1875495914451328:12345-192.168.203.30@tcp:400:kworker.0 00000001:00000004:2.0:1788612783.715746:0:18704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788612783.715821:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2394:x1875495914451328:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 79us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612783.715840:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:2.0:1788612783.715873:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+2:2393:x1875495914451072:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 227us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612783.715881:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 30 00010000:00010000:2.0:1788612783.715930:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788612783.715938:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612783.715942:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612783.716650:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612783.716701:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612783.716728:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612783.716753:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914451456 00000100:00100000:3.0:1788612783.716828:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914451456 00000100:00100000:3.0:1788612783.716867:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914451584 00000100:00100000:3.0:1788612783.716870:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914451584 00000100:00100000:3.0:1788612783.716891:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:3.0:1788612783.716899:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2393:x1875495914451456:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:3.0:1788612783.716921:0:18707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9641 00000100:00080000:3.0:1788612783.717081:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9612e9523800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788612783.717143:0:18707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1788612783.717500:0:19152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:2.0:1788612783.717512:0:19152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8f81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2393:x1875495914451584:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:2.0:1788612783.717532:0:19152:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9648 00000100:00080000:2.0:1788612783.717540:0:19152:0:(import.c:65:import_set_state_nolock()) ffff9612fb870000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788612783.717569:0:19152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:0.0:1788612783.717711:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612783.717727:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a37240e2-533b-4db0-8e7c-d76c26fe9abe+2:2393:x1875495914451456:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 826us (2214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612783.717738:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 31 00010000:00010000:3.0:1788612783.717819:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612783.721251:0:19152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8f81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a37240e2-533b-4db0-8e7c-d76c26fe9abe+2:2393:x1875495914451584:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 3729us (4509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612783.721266:0:19152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00080000:2.0:1788612783.721340:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612783.721345:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612783.725361:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914451200 00000100:00100000:1.0:1788612783.725375:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914451200 00000100:00100000:1.0:1788612783.725456:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 77 00000100:00100000:1.0:1788612783.725468:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:2394:x1875495914451200:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:3.0:1788612783.726036:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612783.726176:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:2394:x1875495914451200:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 708us (9473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612783.726186:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 77 00010000:00010000:0.0:1788612784.047892:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788612784.625780:0:17178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:3.0:1788612784.625796:0:17178:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:0.0:1788612784.625849:0:17238:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:0.0:1788612784.625862:0:17238:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:3.0:1788612785.074244:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612785.136129:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612785.136154:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc73a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932354944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612785.136357:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612785.136423:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612785.136467:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932354944 00000100:00100000:3.0:1788612785.136493:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932354944 00000100:00100000:3.0:1788612785.136552:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788612785.136562:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932354944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788612785.136587:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788612785.136628:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932354944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612785.136635:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788612785.136653:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612785.136684:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc73a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932354944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612785.137199:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612785.137211:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc73bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932355200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612785.137245:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612785.137315:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932355200 00000100:00100000:0.0:1788612785.137320:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932355200 00000100:00100000:0.0:1788612785.137356:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788612785.137362:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932355200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788612785.137386:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788612785.137421:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932355200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612785.137427:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788612785.137453:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc73bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932355200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612785.141856:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8e5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932355072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612785.141943:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612785.142043:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932355072 00000100:00100000:0.0:1788612785.142052:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932355072 00000100:00100000:0.0:1788612785.142132:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788612785.142141:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c6ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932355072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788612785.142164:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00080000:3.0:1788612785.142314:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612785.142393:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c6ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932355072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 252us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612785.142400:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788612785.144600:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8e5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932355072:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788612785.647682:0:17232:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788612785.647690:0:17232:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788612785.647723:0:17232:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788612785.647732:0:17232:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788612785.648802:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc73bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932355328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612785.648871:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612785.649072:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932355328 00000100:00100000:0.0:1788612785.649080:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932355328 00000100:00100000:0.0:1788612785.649141:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788612785.649151:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932355328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788612785.649183:0:17939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788612785.649239:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932355328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612785.649246:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788612785.649364:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc73bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932355328:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788612786.095792:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612787.119778:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612787.183754:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612787.183776:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8f83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932355456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612787.183838:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612787.183909:0:20368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932355456 00000100:00100000:3.0:1788612787.183916:0:20368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932355456 00000100:00100000:3.0:1788612787.183966:0:20368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788612787.183975:0:20368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932355456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788612787.184003:0:20368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788612787.184046:0:20368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932355456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612787.184052:0:20368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788612787.184072:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612787.184128:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8f83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932355456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612787.184406:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932355968:0@lo:400:kworker.0 00000100:00100000:0.0:1788612787.184440:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612787.184497:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932356480:0@lo:400:kworker.0 00000100:00100000:0.0:1788612787.184522:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612787.184539:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932356992:0@lo:400:kworker.0 00000100:00100000:0.0:1788612787.184558:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612787.184574:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788612787.184579:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932355584:0@lo:400:kworker.0 00000100:00100000:0.0:1788612787.184605:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612787.184633:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932356096:0@lo:400:kworker.0 00000100:00100000:0.0:1788612787.184656:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612787.184669:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932356608:0@lo:400:kworker.0 00000100:00100000:0.0:1788612787.184688:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612787.184750:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932355968 00000100:00100000:2.0:1788612787.184755:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932355968 00000100:00100000:2.0:1788612787.184804:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788612787.184812:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932355968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612787.184850:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932355968:12345-0@lo:400:kworker.0 Request processed in 39us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612787.184857:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788612787.184922:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612787.184946:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932355968:0@lo:400:kworker.0 00000100:00100000:1.0:1788612787.185060:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932356480 00000100:00100000:1.0:1788612787.185064:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932356480 00000100:00100000:1.0:1788612787.185087:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932356992 00000100:00100000:1.0:1788612787.185089:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932356992 00000100:00100000:1.0:1788612787.185122:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932356096 00000100:00100000:1.0:1788612787.185126:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932356096 00000100:00100000:1.0:1788612787.185135:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932356608 00000100:00100000:1.0:1788612787.185137:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932356608 00000100:00100000:1.0:1788612787.185148:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788612787.185155:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932356480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612787.185190:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932356480:12345-0@lo:400:kworker.0 Request processed in 35us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612787.185206:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788612787.185219:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788612787.185225:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932356992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612787.185255:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932356992:12345-0@lo:400:kworker.0 Request processed in 30us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612787.185261:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788612787.185272:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788612787.185278:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932356096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612787.185303:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932356096:12345-0@lo:400:kworker.0 Request processed in 26us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612787.185308:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788612787.185320:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788612787.185325:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc73bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932356608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612787.185349:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc73bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932356608:12345-0@lo:400:kworker.0 Request processed in 25us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612787.185354:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788612787.185387:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612e901c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932355840:0@lo:400:kworker.0 00000100:00100000:1.0:1788612787.185413:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612787.185432:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932356352:0@lo:400:kworker.0 00000100:00100000:1.0:1788612787.185452:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612787.185466:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932356864:0@lo:400:kworker.0 00000100:00100000:1.0:1788612787.185527:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612787.185548:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788612787.185555:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c6ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932355712:0@lo:400:kworker.0 00000100:00100000:1.0:1788612787.185585:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612787.185603:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932356224:0@lo:400:kworker.0 00000100:00100000:1.0:1788612787.185622:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612787.185637:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932356736:0@lo:400:kworker.0 00000100:00100000:1.0:1788612787.185656:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612787.185686:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932355712 00000100:00100000:1.0:1788612787.185690:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932355712 00000100:00100000:1.0:1788612787.185713:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932356224 00000100:00100000:1.0:1788612787.185716:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932356224 00000100:00100000:1.0:1788612787.185729:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788612787.185735:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932355712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612787.185785:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932355712:12345-0@lo:400:kworker.0 Request processed in 49us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612787.185792:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788612787.185804:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788612787.185810:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932356224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612787.185838:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932356224:12345-0@lo:400:kworker.0 Request processed in 29us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612787.185844:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788612787.185859:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932356864 00000100:00100000:1.0:1788612787.185863:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932356864 00000100:00100000:1.0:1788612787.185884:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932356736 00000100:00100000:1.0:1788612787.185887:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932356736 00000100:00100000:1.0:1788612787.185904:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788612787.185909:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932356864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612787.185938:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932356864:12345-0@lo:400:kworker.0 Request processed in 29us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612787.185953:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788612787.185965:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788612787.185971:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932356736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612787.185995:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932356736:12345-0@lo:400:kworker.0 Request processed in 25us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612787.186000:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788612787.186032:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932355712:0@lo:400:kworker.0 00000100:00100000:1.0:1788612787.186040:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932356224:0@lo:400:kworker.0 00010000:00080000:1.0:1788612787.186050:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c815ce00 x1875495932356736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612787.186059:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932356736:0@lo:400:kworker.0 00000100:00100000:1.0:1788612787.186067:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932356864:0@lo:400:kworker.0 00000100:00100000:0.0:1788612787.186184:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932356096:0@lo:400:kworker.0 00000100:00100000:0.0:1788612787.186195:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932356608:0@lo:400:kworker.0 00000100:00100000:0.0:1788612787.186204:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932356480:0@lo:400:kworker.0 00010000:00080000:0.0:1788612787.186213:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c815d500 x1875495932356992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612787.186221:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932356992:0@lo:400:kworker.0 00000100:00100000:0.0:1788612787.186232:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612787.186239:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8e5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932357120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612787.186265:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612787.186347:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932355840 00000100:00100000:2.0:1788612787.186351:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932355840 00000100:00100000:2.0:1788612787.186383:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932356352 00000100:00100000:2.0:1788612787.186386:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932356352 00000100:00100000:2.0:1788612787.186406:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788612787.186412:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932355840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612787.186452:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932355840:12345-0@lo:400:kworker.0 Request processed in 39us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612787.186458:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788612787.186469:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788612787.186499:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932356352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612787.186528:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932356352:12345-0@lo:400:kworker.0 Request processed in 54us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612787.186534:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788612787.186556:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612787.186560:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788612787.186563:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788612787.186580:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612e901c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932355840:0@lo:400:kworker.0 00000100:00100000:2.0:1788612787.186589:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932356352:0@lo:400:kworker.0 00000100:00100000:1.0:1788612787.187268:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932357120 00000100:00100000:1.0:1788612787.187275:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932357120 00000100:00100000:1.0:1788612787.187322:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788612787.187330:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc73a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932357120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612787.187347:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788612787.187448:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc73a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932357120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612787.187455:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788612787.187723:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932355584 00000100:00100000:3.0:1788612787.187729:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932355584 00000100:00100000:3.0:1788612787.187770:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788612787.187777:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:3648:x1875495932355584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612787.187814:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:3648:x1875495932355584:12345-0@lo:400:kworker.0 Request processed in 37us (3208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612787.187820:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788612787.189798:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8e5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932357120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612787.189817:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c6ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932355584:0@lo:400:kworker.0 00000100:00100000:1.0:1788612787.281079:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612787.281173:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914451840 00000100:00100000:3.0:1788612787.281182:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914451840 00000100:00100000:3.0:1788612787.281268:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:3.0:1788612787.281277:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+13:16344:x1875495914451840:12345-192.168.203.30@tcp:35:umount.0 00000001:00080000:3.0:1788612787.281563:0:17202:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00100000:3.0:1788612787.281679:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+15:16344:x1875495914451840:12345-192.168.203.30@tcp:35:umount.0 Request processed in 402us (610us total) trans 8589934625 rc 0/0 00000100:00100000:3.0:1788612787.281686:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00000020:00080000:3.0:1788612787.281690:0:17202:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:2.0:1788612787.282140:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612787.285556:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612787.285617:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612787.285718:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914452096 00000100:00100000:0.0:1788612787.285727:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914452096 00000100:00100000:0.0:1788612787.285790:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914451968 00000100:00100000:0.0:1788612787.285793:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914451968 00000100:00100000:0.0:1788612787.285821:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:0.0:1788612787.285832:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8f83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:793580fe-2c90-4d10-b55f-7f369e961e59+14:2396:x1875495914452096:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612787.285860:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612787.285879:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9613020f5c00/0x1f8616bf0bc95e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22547 expref: 14 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612787.285898:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612787.285960:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8f83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:793580fe-2c90-4d10-b55f-7f369e961e59+13:2396:x1875495914452096:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 129us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612787.285967:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:0.0:1788612787.285985:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:0.0:1788612787.285991:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c13ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:793580fe-2c90-4d10-b55f-7f369e961e59+12:2396:x1875495914451968:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612787.285999:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612787.286008:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c799ac00/0x1f8616bf0bc95df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22516 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612787.286017:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612787.286035:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c13ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:793580fe-2c90-4d10-b55f-7f369e961e59+11:2396:x1875495914451968:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 44us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612787.286042:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:1.0:1788612787.292126:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612787.292327:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914452224 00000100:00100000:0.0:1788612787.292337:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914452224 00000100:00100000:0.0:1788612787.292401:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:0.0:1788612787.292411:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:793580fe-2c90-4d10-b55f-7f369e961e59+11:2396:x1875495914452224:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612787.292426:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612787.292443:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9613020f5e00/0x1f8616bf0bc966b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225fd expref: 11 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612787.292459:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612787.292564:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:793580fe-2c90-4d10-b55f-7f369e961e59+10:2396:x1875495914452224:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 154us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612787.292572:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:0.0:1788612787.298646:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612787.298752:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914452352 00000100:00100000:2.0:1788612787.298762:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914452352 00000100:00100000:2.0:1788612787.298839:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:2.0:1788612787.298851:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2393:x1875495914452352:12345-192.168.203.30@tcp:9:umount.0 00000020:00000080:2.0:1788612787.298887:0:18706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9609 00000100:00080000:2.0:1788612787.298895:0:18706:0:(import.c:65:import_set_state_nolock()) ffff9611c663b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788612787.298955:0:18706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1788612787.299107:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+2:2393:x1875495914452352:12345-192.168.203.30@tcp:9:umount.0 Request processed in 246us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612787.299115:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00080000:0.0:1788612787.299296:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788612787.299430:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612787.307276:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612787.307440:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914453248 00000100:00100000:1.0:1788612787.307452:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914453248 00000100:00100000:1.0:1788612787.307563:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:1.0:1788612787.307574:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8f83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+15:2393:x1875495914453248:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:1.0:1788612787.307604:0:17198:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc95f4 00000020:00010000:1.0:1788612787.307619:0:17198:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9612fb872000: total 0 00000100:00080000:1.0:1788612787.307624:0:17198:0:(import.c:65:import_set_state_nolock()) ffff9612fb877800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788612787.307652:0:17198:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934625 00000100:00100000:1.0:1788612787.307805:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8f83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a43cb079-defd-42bd-a3d5-1be09fd1336b+14:2393:x1875495914453248:12345-192.168.203.30@tcp:39:umount.0 Request processed in 233us (539us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1788612787.307813:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000020:00010000:3.0:1788612787.308838:0:17186:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9612fb872000: total 0 00010000:00010000:3.0:1788612787.308845:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612787.308896:0:17186:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9612fb872000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788612787.308943:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9612c93f7700) 00010000:00010000:3.0:1788612787.308948:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612787.308958:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc96bf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22604 expref: 13 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612787.309007:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9612fb831100) 00010000:00010000:3.0:1788612787.309011:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788612787.309016:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3a00/0x1f8616bf0bc979f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22643 expref: 12 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612787.309032:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:3.0:1788612787.309035:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788612787.309039:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1c00/0x1f8616bf0bc984e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22682 expref: 11 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612787.309050:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:3.0:1788612787.309053:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788612787.309056:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9613020f4e00/0x1f8616bf0bc981d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2266d expref: 10 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612787.309068:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9612c93f7b00) 00010000:00010000:3.0:1788612787.309071:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788612787.309074:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0200/0x1f8616bf0bc9904 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226ba expref: 9 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612787.309119:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9612fb831700) 00010000:00010000:3.0:1788612787.309122:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612787.309126:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d0a00/0x1f8616bf0bc96db lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2260b expref: 8 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612787.309141:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7c00) 00010000:00010000:3.0:1788612787.309143:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612787.309156:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc971a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22619 expref: 7 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612787.309173:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9612c93f7100) 00010000:00010000:3.0:1788612787.309175:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788612787.309179:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37a00/0x1f8616bf0bc98a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22697 expref: 6 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612787.309191:0:17186:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9612fb872000, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1788612787.309316:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612787.309319:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612787.309321:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612787.325066:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612787.325159:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914453376 00000100:00100000:1.0:1788612787.325169:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914453376 00000100:00100000:1.0:1788612787.325256:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:1.0:1788612787.325265:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+5:2393:x1875495914453376:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:1.0:1788612787.325296:0:17199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc95fb 00000100:00080000:1.0:1788612787.325313:0:17199:0:(import.c:65:import_set_state_nolock()) ffff9612d1e73800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788612787.325345:0:17199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788612787.325604:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a43cb079-defd-42bd-a3d5-1be09fd1336b+3:2393:x1875495914453376:12345-192.168.203.30@tcp:39:umount.0 Request processed in 338us (546us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788612787.325612:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00080000:0.0:1788612787.326298:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788612787.331062:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612788.147220:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612788.828047:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612788.828110:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612788.828303:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612788.828399:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914453632 00000100:00100000:1.0:1788612788.828413:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914453632 00000100:00100000:1.0:1788612788.828472:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914453760 00000100:00100000:1.0:1788612788.828507:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914453760 00000100:00100000:1.0:1788612788.828534:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:1.0:1788612788.828544:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:2397:x1875495914453632:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612788.828640:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:2397:x1875495914453632:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 97us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612788.828647:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:1.0:1788612788.828664:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00100000:1.0:1788612788.828671:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc73b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2397:x1875495914453760:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612788.828710:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc73b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2397:x1875495914453760:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 39us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612788.828716:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00080000:0.0:1788612788.829041:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788612788.829045:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788612788.833800:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914453504 00000100:00100000:2.0:1788612788.833814:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914453504 00000100:00100000:2.0:1788612788.833891:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 171 00000100:00100000:2.0:1788612788.833901:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+10:2397:x1875495914453504:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612788.833985:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:793580fe-2c90-4d10-b55f-7f369e961e59+10:2397:x1875495914453504:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 85us (5873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612788.833993:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 171 00010000:00010000:3.0:1788612789.168013:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612789.245877:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612789.245925:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612789.245963:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612789.246059:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914453888 00000100:00100000:1.0:1788612789.246069:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914453888 00000100:00100000:1.0:1788612789.246146:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914454144 00000100:00100000:1.0:1788612789.246149:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914454144 00000100:00100000:1.0:1788612789.246164:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914454016 00000100:00100000:1.0:1788612789.246166:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914454016 00000100:00100000:1.0:1788612789.246183:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:1.0:1788612789.246191:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc738380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:793580fe-2c90-4d10-b55f-7f369e961e59+12:2397:x1875495914453888:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612789.246206:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612789.246225:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c0031000/0x1f8616bf0bc961e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22586 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612789.246244:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612789.246299:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc738380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:793580fe-2c90-4d10-b55f-7f369e961e59+11:2397:x1875495914453888:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 108us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612789.246307:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:1.0:1788612789.246324:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:1.0:1788612789.246330:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c79a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:793580fe-2c90-4d10-b55f-7f369e961e59+10:2397:x1875495914454144:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612789.246353:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612789.246363:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c799bc00/0x1f8616bf0bc9664 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225f6 expref: 10 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612789.246371:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612789.246390:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c79a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:793580fe-2c90-4d10-b55f-7f369e961e59+9:2397:x1875495914454144:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 60us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612789.246396:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:1.0:1788612789.246410:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:1.0:1788612789.246416:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:793580fe-2c90-4d10-b55f-7f369e961e59+8:2397:x1875495914454016:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788612789.246423:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612789.246432:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9613020f4a00/0x1f8616bf0bc9625 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d225b7 expref: 8 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612789.246441:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612789.246459:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:793580fe-2c90-4d10-b55f-7f369e961e59+7:2397:x1875495914454016:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 44us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612789.246465:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:1.0:1788612789.268668:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612789.268777:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914454400 00000100:00100000:2.0:1788612789.268787:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914454400 00000100:00100000:2.0:1788612789.268859:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:2.0:1788612789.268871:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+6:2393:x1875495914454400:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:2.0:1788612789.268917:0:17198:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9633 00000020:00010000:2.0:1788612789.268925:0:17198:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9611c663d000: total 0 00000100:00080000:2.0:1788612789.268930:0:17198:0:(import.c:65:import_set_state_nolock()) ffff9611c663c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788612789.268977:0:17198:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000020:00010000:3.0:1788612789.269399:0:17186:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9611c663d000: total 0 00010000:00010000:3.0:1788612789.269451:0:17186:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9611c663d000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788612789.269522:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7c00) 00010000:00010000:3.0:1788612789.269526:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612789.269536:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c13d1000/0x1f8616bf0bc9728 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22620 expref: 5 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612789.269562:0:17186:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9611c663d000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788612789.269574:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612789.269577:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612789.269578:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612789.270072:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a37240e2-533b-4db0-8e7c-d76c26fe9abe+3:2393:x1875495914454400:12345-192.168.203.30@tcp:39:umount.0 Request processed in 1200us (1409us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1788612789.270092:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:1.0:1788612789.289835:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612789.289976:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914454528 00000100:00100000:2.0:1788612789.289986:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914454528 00000100:00100000:2.0:1788612789.290109:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:2.0:1788612789.290121:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+5:2393:x1875495914454528:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:2.0:1788612789.290172:0:17199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc963a 00000100:00080000:2.0:1788612789.290184:0:17199:0:(import.c:65:import_set_state_nolock()) ffff9612e9525000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788612789.290213:0:17199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788612789.290378:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a37240e2-533b-4db0-8e7c-d76c26fe9abe+3:2393:x1875495914454528:12345-192.168.203.30@tcp:39:umount.0 Request processed in 258us (552us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788612789.290387:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 70 00010000:00010000:1.0:1788612789.290694:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612789.321921:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612789.322214:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914454784 00000100:00100000:1.0:1788612789.322225:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914454784 00000100:00100000:1.0:1788612789.322291:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 172 00000100:00100000:1.0:1788612789.322301:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+7:2393:x1875495914454784:12345-192.168.203.30@tcp:251:umount.0 00000020:00000080:1.0:1788612789.322348:0:17193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc95d1 00000020:00010000:1.0:1788612789.322369:0:17193:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9611c8052000: total 0 00000100:00080000:1.0:1788612789.322374:0:17193:0:(import.c:65:import_set_state_nolock()) ffff9611c8056000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788612789.322454:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:793580fe-2c90-4d10-b55f-7f369e961e59+3:2393:x1875495914454784:12345-192.168.203.30@tcp:251:umount.0 Request processed in 155us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612789.322463:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 172 00000020:00010000:3.0:1788612789.326515:0:17186:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9611c8052000: total 0 00010000:00010000:3.0:1788612789.326535:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612789.326595:0:17186:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9611c8052000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788612789.326631:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9613020f4200/0x1f8616bf0bc95d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2250f expref: 2 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612789.326662:0:17186:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9611c8052000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788612789.326674:0:17186:0:(genops.c:885:class_export_put()) final put ffff9611c8052000/793580fe-2c90-4d10-b55f-7f369e961e59 00010000:00010000:3.0:1788612789.326696:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612789.326703:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612789.326704:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788612789.326901:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c8052000/793580fe-2c90-4d10-b55f-7f369e961e59 for MGS 00000020:00000080:0.0:1788612789.326939:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c8056000 for MGS 00000001:00100000:2.0:1788612789.754065:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a37240e2-533b-4db0-8e7c-d76c26fe9abe 00000020:00000080:2.0:1788612789.754076:0:19518:0:(genops.c:885:class_export_put()) final put ffff9612fb875800/a37240e2-533b-4db0-8e7c-d76c26fe9abe 00000001:00100000:2.0:1788612789.754116:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a43cb079-defd-42bd-a3d5-1be09fd1336b 00000020:00000080:2.0:1788612789.754119:0:19518:0:(genops.c:885:class_export_put()) final put ffff9612d1e76000/a43cb079-defd-42bd-a3d5-1be09fd1336b 00000020:00000080:1.0:1788612789.754187:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fb875800/a37240e2-533b-4db0-8e7c-d76c26fe9abe for lustre-OST0001 00000001:00100000:3.0:1788612789.758430:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a43cb079-defd-42bd-a3d5-1be09fd1336b 00000020:00000080:3.0:1788612789.758441:0:18701:0:(genops.c:885:class_export_put()) final put ffff9611c6638000/a43cb079-defd-42bd-a3d5-1be09fd1336b 00000020:00000080:1.0:1788612789.760750:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9612d1e76000/a43cb079-defd-42bd-a3d5-1be09fd1336b for lustre-OST0001 00000001:00100000:3.0:1788612789.760818:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a37240e2-533b-4db0-8e7c-d76c26fe9abe 00000020:00000080:3.0:1788612789.760823:0:18701:0:(genops.c:885:class_export_put()) final put ffff9612e9520800/a37240e2-533b-4db0-8e7c-d76c26fe9abe 00000020:00000080:2.0:1788612789.761210:0:15779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612fb870000 for lustre-OST0001 00000020:00000080:2.0:1788612789.761217:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c6638000/a43cb079-defd-42bd-a3d5-1be09fd1336b for lustre-OST0000 00000020:00000080:2.0:1788612789.761250:0:15779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612d1e70000 for lustre-OST0001 00000020:00000080:2.0:1788612789.761255:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9612e9520800/a37240e2-533b-4db0-8e7c-d76c26fe9abe for lustre-OST0000 00000020:00000080:2.0:1788612789.761271:0:15779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c663b000 for lustre-OST0000 00000020:00000080:2.0:1788612789.761274:0:15779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612e9523800 for lustre-OST0000 00010000:00010000:1.0:1788612790.191882:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612790.256760:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932357248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612790.256926:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612790.257045:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932357248 00000100:00100000:1.0:1788612790.257052:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932357248 00000100:00100000:1.0:1788612790.257339:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788612790.257348:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932357248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788612790.257376:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788612790.257417:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932357248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612790.257424:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788612790.257444:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788612790.257616:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932357248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788612790.257633:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612790.257639:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932357376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612790.257664:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612790.257903:0:20368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932357376 00000100:00100000:1.0:1788612790.257907:0:20368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932357376 00000100:00100000:1.0:1788612790.257951:0:20368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788612790.258052:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612790.258087:0:20368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932357376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788612790.258099:0:20368:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788612790.259391:0:20368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932357376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1427us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612790.259403:0:20368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788612790.259501:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932357376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612790.261421:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612790.261441:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c815d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932357504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612790.262287:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612790.262559:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932357504 00000100:00100000:0.0:1788612790.262567:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932357504 00000100:00100000:0.0:1788612790.262614:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788612790.262624:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932357504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788612790.262656:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788612790.262721:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932357504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612790.262728:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788612790.263223:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c815d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932357504:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788612790.451246:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788612790.767830:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932357632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788612790.767926:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612790.768096:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932357632 00000100:00100000:0.0:1788612790.768105:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932357632 00000100:00100000:0.0:1788612790.768160:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788612790.768179:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932357632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788612790.768211:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788612790.768260:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932357632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612790.768267:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788612790.768311:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932357632:0@lo:41:osp-pre-1-0.0 00000020:01000004:2.0:1788612791.193982:0:20767:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788612791.202781:0:20767:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788612791.202855:0:20767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7241800/0x1f8616bf0bc9194 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc919b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.202870:0:20767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7241800/0x1f8616bf0bc9194 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc919b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.202878:0:20767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7241800/0x1f8616bf0bc9194 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc919b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.202885:0:20767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9612c7241800/0x1f8616bf0bc9194 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc919b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.202906:0:20767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788612791.202911:0:20767:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788612791.202934:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788612791.202939:0:20767:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788612791.202944:0:20767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788612791.202968:0:20767:0:(import.c:65:import_set_state_nolock()) ffff9611c674a000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788612791.203002:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612791.203009:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c7241800/0x1f8616bf0bc9194 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc919b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.203017:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241800 already unused, calling callback (ffffffffc123cc20) 00000100:00100000:1.0:1788612791.203018:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875495932357760:0@lo:39:umount.0 10000000:00010000:3.0:1788612791.203020:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c7241800/0x1f8616bf0bc9194 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc919b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.203028:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c7241800/0x1f8616bf0bc9194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc919b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612791.203035:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c7241800/0x1f8616bf0bc9194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc919b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612791.203040:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788612791.203056:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788612791.203058:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788612791.203094:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c7241800/0x1f8616bf0bc9194 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc919b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612791.203096:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788612791.203100:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612791.203118:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c7241800/0x1f8616bf0bc9194 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc919b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.203125:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c7241800/0x1f8616bf0bc9194 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc919b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.203136:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612791.203138:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612791.203140:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612791.203149:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d240c1fb-ce1c-496f-9994-daecd37f5c24:3650:1875495932357888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612791.203181:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612791.203356:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932357760 00000100:00100000:0.0:1788612791.203364:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932357760 00000100:00100000:0.0:1788612791.203414:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788612791.203423:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875495932357760:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788612791.203455:0:17198:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc91c5 00000100:00080000:0.0:1788612791.203462:0:17198:0:(import.c:65:import_set_state_nolock()) ffff9612c7665800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788612791.206731:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1875495932357760:12345-0@lo:39:umount.0 Request processed in 3303us (3629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612791.206746:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:0.0:1788612791.206761:0:17198:0:(genops.c:885:class_export_put()) final put ffff9612c7664800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788612791.208127:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c7664800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1788612791.208145:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932357888 00000100:00100000:0.0:1788612791.208155:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932357888 00000020:00000080:3.0:1788612791.208192:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612c7665800 for lustre-MDT0000 00000100:00100000:0.0:1788612791.208218:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788612791.208227:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7842d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:3650:x1875495932357888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612791.208241:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612791.208257:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c7240400/0x1f8616bf0bc919b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc9194 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.208271:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612791.208342:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7842d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:3650:x1875495932357888:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (5160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612791.208348:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788612791.208384:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788612791.208460:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c674a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788612791.208494:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875495932357760:0@lo:39:umount.0 00000100:00080000:0.0:1788612791.208585:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788612791.208589:0:20767:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788612791.208594:0:20767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788612791.210207:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d240c1fb-ce1c-496f-9994-daecd37f5c24:3650:1875495932357888:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612791.215776:0:20767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240e00/0x1f8616bf0bc90e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90ec expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.215792:0:20767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240e00/0x1f8616bf0bc90e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc90ec expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.215797:0:20767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240e00/0x1f8616bf0bc90e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc90ec expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.215815:0:20767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9612c7240e00/0x1f8616bf0bc90e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc90ec expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.215835:0:20767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612791.215840:0:20767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc94f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc94f8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.215844:0:20767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc94f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc94f8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.215848:0:20767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc94f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc94f8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.215851:0:20767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc94f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc94f8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.215862:0:20767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788612791.215866:0:20767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc969c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc96a3 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.215870:0:20767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc969c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc96a3 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.215873:0:20767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc969c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc96a3 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.215877:0:20767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc969c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc96a3 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.215889:0:20767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788612791.215893:0:20767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7241000/0x1f8616bf0bc90d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc90de expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.215897:0:20767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7241000/0x1f8616bf0bc90d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc90de expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.215900:0:20767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7241000/0x1f8616bf0bc90d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc90de expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.215904:0:20767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9612c7241000/0x1f8616bf0bc90d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc90de expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612791.215907:0:20767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788612791.215909:0:20767:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788612791.215938:0:20767:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00010000:00010000:3.0:1788612791.215940:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:01000000:0.0:1788612791.215943:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:3.0:1788612791.215949:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c7240e00/0x1f8616bf0bc90e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc90ec expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788612791.215949:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612791.215954:0:20767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00010000:00010000:3.0:1788612791.215963:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240e00 already unused, calling callback (ffffffffc123cc20) 00000020:00080000:0.0:1788612791.215964:0:20767:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9611c591f000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:3.0:1788612791.215971:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c7240e00/0x1f8616bf0bc90e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc90ec expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788612791.215973:0:20767:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9611c882a000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788612791.215985:0:20767:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9611c68fd800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788612791.215991:0:20767:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9612d8ac9000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1788612791.215992:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c7240e00/0x1f8616bf0bc90e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc90ec expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788612791.215999:0:20767:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9611c663d000 a37240e2-533b-4db0-8e7c-d76c26fe9abe 192.168.203.30@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 10000000:00010000:3.0:1788612791.216011:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c7240e00/0x1f8616bf0bc90e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc90ec expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788612791.216014:0:20767:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9612fb872000 a43cb079-defd-42bd-a3d5-1be09fd1336b 192.168.203.30@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:0.0:1788612791.216026:0:20767:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9612fe9eb380) has exports, disconnecting them 10000000:01000000:3.0:1788612791.216028:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788612791.216031:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1788612791.216033:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:00080000:0.0:1788612791.216041:0:20767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9611c591f000), last request at 1788612787 00000020:00000080:0.0:1788612791.216049:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc94c0 00000100:00080000:0.0:1788612791.216064:0:20767:0:(import.c:65:import_set_state_nolock()) ffff9611c591f800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788612791.216083:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c7240e00/0x1f8616bf0bc90e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc90ec expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.216092:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612791.216118:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c7240e00/0x1f8616bf0bc90e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc90ec expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.216125:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c7240e00/0x1f8616bf0bc90e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc90ec expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788612791.216134:0:20767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9611c591f000): rc 0 00000020:00000080:0.0:1788612791.216137:0:20767:0:(genops.c:885:class_export_put()) final put ffff9611c591f000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1788612791.216143:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788612791.216148:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc94f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc94f8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788612791.216152:0:20767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9611c882a000), last request at 1788612787 00000020:00000080:0.0:1788612791.216159:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9362 00010000:00010000:3.0:1788612791.216160:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613020f5a00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612791.216165:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc94f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc94f8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788612791.216167:0:20767:0:(import.c:65:import_set_state_nolock()) ffff9611c882f800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788612791.216177:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc94f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc94f8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612791.216183:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc94f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc94f8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612791.216199:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788612791.216201:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788612791.216203:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788612791.216220:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc94f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc94f8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.216226:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612791.216242:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc94f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc94f8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.216249:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9613020f5a00/0x1f8616bf0bc94f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc94f8 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.216260:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612791.216263:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc969c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc96a3 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.216270:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2e00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612791.216277:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc969c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc96a3 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.216284:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc969c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc96a3 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612791.216289:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc969c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc96a3 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612791.216294:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788612791.216297:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788612791.216298:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788612791.216318:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc969c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc96a3 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.216325:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612791.216331:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc969c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc96a3 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.216337:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc969c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc96a3 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.216346:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612791.216349:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c7241000/0x1f8616bf0bc90d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc90de expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.216354:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241000 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612791.216357:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c7241000/0x1f8616bf0bc90d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc90de expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.216364:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c7241000/0x1f8616bf0bc90d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc90de expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612791.216369:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c7241000/0x1f8616bf0bc90d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc90de expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612791.216373:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788612791.216375:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788612791.216377:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788612791.216389:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c7241000/0x1f8616bf0bc90d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc90de expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.216395:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612791.216401:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c7241000/0x1f8616bf0bc90d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc90de expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788612791.216413:0:20767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9611c882a000): rc 0 00010000:00010000:3.0:1788612791.216414:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c7241000/0x1f8616bf0bc90d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc90de expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788612791.216418:0:20767:0:(genops.c:885:class_export_put()) final put ffff9611c882a000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1788612791.216428:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788612791.216431:0:20767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9611c68fd800), last request at 1788612718 00010000:00010000:3.0:1788612791.216433:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612791.216437:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788612791.216438:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc92b3 00000100:00100000:3.0:1788612791.216456:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d240c1fb-ce1c-496f-9994-daecd37f5c24:3649:1875495932358272:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788612791.216457:0:20767:0:(import.c:65:import_set_state_nolock()) ffff9611c68f9800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788612791.216473:0:20767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9611c68fd800): rc 0 00000020:00000080:0.0:1788612791.216507:0:20767:0:(genops.c:885:class_export_put()) final put ffff9611c68fd800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788612791.216512:0:20767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9612d8ac9000), last request at 1788612718 00000020:00000080:0.0:1788612791.216516:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9251 00000100:00080000:0.0:1788612791.216520:0:20767:0:(import.c:65:import_set_state_nolock()) ffff9612c7662800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788612791.216527:0:20767:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:3.0:1788612791.216550:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788612791.216604:0:20767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9612d8ac9000): rc 0 00000004:00000080:0.0:1788612791.216611:0:20767:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa9b947ac3ae0 00000100:00100000:3.0:1788612791.216612:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612791.216622:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d240c1fb-ce1c-496f-9994-daecd37f5c24:3649:1875495932358144:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788612791.216629:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788612791.216632:0:20767:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1788612791.216649:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612791.216682:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932358272 00000100:00100000:3.0:1788612791.216690:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932358272 00000100:00100000:3.0:1788612791.216732:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932358144 00000100:00100000:3.0:1788612791.216735:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932358144 00000100:00100000:3.0:1788612791.216757:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788612791.216766:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d240c1fb-ce1c-496f-9994-daecd37f5c24+24:3649:x1875495932358272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612791.216780:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612791.216795:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9613020f5200/0x1f8616bf0bc96a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc969c expref: 24 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.216807:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612791.216842:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d240c1fb-ce1c-496f-9994-daecd37f5c24+23:3649:x1875495932358272:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612791.216850:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788612791.216866:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788612791.216873:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c13e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:3649:x1875495932358144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612791.216888:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612791.216898:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c799a000/0x1f8616bf0bc94f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc94f1 expref: 22 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.216908:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612791.216931:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c13e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:3649:x1875495932358144:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612791.216938:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788612791.216989:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932358016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612791.217013:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612791.217031:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612791.217037:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932358400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612791.217056:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612791.217091:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932358016 00000100:00100000:3.0:1788612791.217095:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932358016 00000100:00100000:3.0:1788612791.217118:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932358400 00000100:00100000:3.0:1788612791.217120:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932358400 00000100:00100000:3.0:1788612791.217136:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788612791.217142:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+22:3651:x1875495932358016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612791.217148:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612791.217157:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c7241e00/0x1f8616bf0bc90ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc90e5 expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.217167:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612791.217194:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+21:3651:x1875495932358016:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612791.217200:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788612791.217213:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788612791.217226:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc738380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+20:3651:x1875495932358400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612791.217234:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612791.217243:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c7241600/0x1f8616bf0bc90de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc90d7 expref: 20 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612791.217252:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612791.217274:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc738380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d240c1fb-ce1c-496f-9994-daecd37f5c24+19:3651:x1875495932358400:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612791.217280:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000020:00000080:3.0:1788612791.217301:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c591f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788612791.217339:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c882a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788612791.217365:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c68fd800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788612791.217389:0:15779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c591f800 for lustre-MDT0000 00000020:00000080:3.0:1788612791.217393:0:15779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c882f800 for lustre-MDT0000 00000020:00000080:3.0:1788612791.217397:0:15779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c68f9800 for lustre-MDT0000 00000100:00080000:0.0:1788612791.217398:0:20767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788612791.217417:0:20767:0:(import.c:65:import_set_state_nolock()) ffff9612f7afa800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788612791.217429:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932358400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612791.217440:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932358016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612791.217564:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d240c1fb-ce1c-496f-9994-daecd37f5c24:3649:1875495932358144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612791.217573:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d240c1fb-ce1c-496f-9994-daecd37f5c24:3649:1875495932358272:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612791.217592:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788612791.217767:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788612791.217771:0:20767:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1788612791.217789:0:20767:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788612791.217857:0:20767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788612791.217868:0:20767:0:(import.c:65:import_set_state_nolock()) ffff961300767000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788612791.217874:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788612791.217876:0:20767:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1788612791.217884:0:20767:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788612791.218139:0:20767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788612791.218150:0:20767:0:(import.c:65:import_set_state_nolock()) ffff961300767800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788612791.218182:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612791.218218:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932358528:0@lo:39:umount.0 00000100:00100000:1.0:1788612791.218269:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788612791.218275:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9612fe9eb380) has no exports 00000100:00100000:1.0:1788612791.218308:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932358528 00000100:00100000:1.0:1788612791.218314:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932358528 00000100:00100000:1.0:1788612791.218358:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788612791.218367:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875495932358528:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788612791.218390:0:17203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc92dd 00000100:00080000:1.0:1788612791.218397:0:17203:0:(import.c:65:import_set_state_nolock()) ffff9612e92bd000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788612791.218417:0:17203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788612791.218465:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932358656:0@lo:9:umount.0 00000100:00100000:1.0:1788612791.218568:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3647:x1875495932358528:12345-0@lo:39:umount.0 Request processed in 200us (298us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788612791.218573:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612791.218582:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788612791.218607:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932358784:0@lo:9:umount.0 00000100:00100000:0.0:1788612791.218634:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788612791.218646:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612791.218661:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932358656 00000100:00100000:0.0:1788612791.218666:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932358656 00000100:00100000:0.0:1788612791.218699:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932358784 00000100:00100000:0.0:1788612791.218702:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932358784 00000100:00100000:0.0:1788612791.218726:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788612791.218732:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875495932358656:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788612791.218747:0:18707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc93a8 00000100:00080000:0.0:1788612791.218752:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9611c1091000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788612791.218781:0:18707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788612791.218840:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788612791.218851:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875495932358784:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788612791.218866:0:18706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc94ff 00000100:00080000:1.0:1788612791.218872:0:18706:0:(import.c:65:import_set_state_nolock()) ffff9612d1e71800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788612791.218899:0:18706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788612791.218968:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3647:x1875495932358656:12345-0@lo:9:umount.0 Request processed in 235us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612791.218975:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788612791.218998:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3647:x1875495932358784:12345-0@lo:9:umount.0 Request processed in 149us (363us total) trans 0 rc 0/0 00000100:00080000:0.0:1788612791.219087:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961300767800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788612791.219098:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788612791.219099:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788612791.219102:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788612791.219107:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932358784:0@lo:9:umount.0 00000100:00080000:0.0:1788612791.219132:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612f7afa800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788612791.219136:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932358528:0@lo:39:umount.0 00000100:00080000:0.0:1788612791.219144:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961300767000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788612791.219226:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788612791.219228:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788612791.219231:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932358656:0@lo:9:umount.0 00010000:00010000:0.0:1788612791.219311:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612791.219316:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612791.221127:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612791.221197:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000020:00080000:0.0:1788612791.228549:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9612fe9eb380) has no exports 00000020:00000080:0.0:1788612791.287920:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9132 00000020:00000080:0.0:1788612791.287936:0:20767:0:(genops.c:885:class_export_put()) final put ffff9612fcd0e000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788612791.287962:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788612791.288009:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fcd0e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788612791.288059:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788612791.288082:0:20767:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788612791.288088:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9611c5a20000) has no exports 00000020:00000080:2.0:1788612791.289352:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc912b 00000020:00000080:2.0:1788612791.289363:0:20767:0:(genops.c:885:class_export_put()) final put ffff9612fcd0a000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788612791.289854:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788612791.289865:0:20767:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788612791.289869:0:20767:0:(genops.c:885:class_export_put()) final put ffff9611c816a800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788612791.289872:0:20767:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c816a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788612791.290185:0:20767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788612791.291303:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fcd0a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788612792.240048:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612792.303874:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932358912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612792.303946:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612792.304087:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932358912 00000100:00100000:2.0:1788612792.304095:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932358912 00000100:00100000:2.0:1788612792.304162:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788612792.304171:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932358912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788612792.304201:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788612792.304259:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932358912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612792.304267:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788612792.304316:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932358912:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788612792.304334:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612792.304500:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932359040:0@lo:400:kworker.0 00000100:00100000:0.0:1788612792.304517:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932359424:0@lo:400:kworker.0 00000100:00100000:1.0:1788612792.304542:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612792.304554:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612792.304569:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932359552:0@lo:400:kworker.0 00000100:00100000:0.0:1788612792.304569:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932359936:0@lo:400:kworker.0 00000100:00100000:0.0:1788612792.304589:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612792.304612:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788612792.304616:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612792.304617:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932359296:0@lo:400:kworker.0 00000100:00100000:1.0:1788612792.304633:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788612792.304637:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932359168:0@lo:400:kworker.0 00000100:00100000:0.0:1788612792.304641:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612792.304656:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932359808:0@lo:400:kworker.0 00000100:00100000:1.0:1788612792.304659:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612792.304672:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932359680:0@lo:400:kworker.0 00000100:00100000:0.0:1788612792.304674:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612792.304711:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612792.304713:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932359296 00000100:00100000:0.0:1788612792.304717:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932359296 00000100:00100000:1.0:1788612792.304739:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932359424 00000100:00100000:1.0:1788612792.304742:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932359424 00000100:00100000:0.0:1788612792.304746:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788612792.304752:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932359296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612792.304756:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932359936 00000100:00100000:1.0:1788612792.304758:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932359936 00000100:00100000:1.0:1788612792.304770:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932359552 00000100:00100000:1.0:1788612792.304772:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932359552 00000100:00100000:1.0:1788612792.304779:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932359808 00000100:00100000:1.0:1788612792.304781:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932359808 00000100:00100000:0.0:1788612792.304787:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932359296:12345-0@lo:400:kworker.0 Request processed in 36us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612792.304789:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932359680 00000100:00100000:1.0:1788612792.304790:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932359680 00000100:00100000:0.0:1788612792.304794:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788612792.304802:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788612792.304808:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932359936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612792.304819:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932359296:0@lo:400:kworker.0 00000100:00100000:2.0:1788612792.304882:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788612792.304891:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932359680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612792.304930:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932359680:12345-0@lo:400:kworker.0 Request processed in 41us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612792.304936:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788612792.304951:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788612792.304955:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1875495932359424:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788612792.304960:0:17199:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788612792.305025:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932359040 00000100:00100000:3.0:1788612792.305030:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932359040 00000100:00100000:3.0:1788612792.305068:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788612792.305084:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+19:3648:x1875495932359040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612792.305118:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d240c1fb-ce1c-496f-9994-daecd37f5c24+19:3648:x1875495932359040:12345-0@lo:400:kworker.0 Request processed in 36us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612792.305125:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788612792.305152:0:17200:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788612792.305159:0:17200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788612792.305176:0:20193:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788612792.305183:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788612792.305188:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875495932359552:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788612792.305193:0:20193:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788612792.305215:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875495932359552:12345-0@lo:400:kworker.0 Request processed in 26us (597us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788612792.305221:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788612792.305233:0:20193:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788612792.305239:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788612792.305243:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1875495932359808:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788612792.305247:0:20193:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788612792.305887:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932359936:12345-0@lo:400:kworker.0 Request processed in 1075us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612792.305895:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788612792.305940:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932359168 00000100:00100000:1.0:1788612792.305946:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932359168 00000100:00100000:1.0:1788612792.305973:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788612792.305978:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1875495932359168:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788612792.305984:0:17939:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788612792.306024:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1875495932359168:12345-0@lo:400:kworker.0 Request processed in 44us (1363us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788612792.306031:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1788612792.306051:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788612792.306055:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788612792.306194:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788612792.306199:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9611c68fe000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788612792.306202:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788612792.309399:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3651:x1875495932359424:12345-0@lo:400:kworker.0 Request processed in 4432us (4845us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788612792.309415:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788612792.314728:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1875495932359808:12345-0@lo:400:kworker.0 Request processed in 9473us (10042us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788612792.314744:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788612792.324732:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788612792.324739:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9612c6ac1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788612792.324744:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788612792.324750:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9612c6ac1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788612792.324755:0:3651:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 565 00000100:00080000:0.0:1788612792.324764:0:3651:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9612c6ac1800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612792.324805:0:3651:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612febbe680 x1875495932360064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612792.324840:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932359808:0@lo:400:kworker.0 00000100:00080000:0.0:1788612792.324857:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788612792.324860:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9611c8053000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788612792.324863:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788612792.324865:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9611c8053000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788612792.325369:0:3651:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 533 00000100:00080000:0.0:1788612792.325375:0:3651:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9611c8053000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612792.325394:0:3651:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612febbf480 x1875495932360192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612792.325420:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932359424:0@lo:400:kworker.0 00010000:00080000:0.0:1788612792.325441:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612febbea00 x1875495932359936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612792.325453:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932359936:0@lo:400:kworker.0 00000100:00100000:2.0:1788612792.327165:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932360064:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788612792.327238:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612792.327286:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875495932360192:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788612792.327311:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612792.327673:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932360064 00000100:00100000:0.0:1788612792.327682:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932360064 00000100:00100000:0.0:1788612792.327717:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932360192 00000100:00100000:0.0:1788612792.327720:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932360192 00000100:00100000:0.0:1788612792.327738:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788612792.327745:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932360064:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1788612792.327762:0:17198:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788612792.327838:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788612792.327844:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c815d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932360192:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788612792.327852:0:17200:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788612792.327900:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932360192:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 54us (588us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788612792.327981:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788612792.328023:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c8053000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788612792.328028:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788612792.328032:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875495932360192:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1788612792.329364:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9611c68fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612792.329372:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 532 00000100:00080000:1.0:1788612792.329381:0:3648:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9611c68fe000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612792.329783:0:3648:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc76c700 x1875495932360320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788612792.329810:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932359168:0@lo:400:kworker.0 00010000:00080000:1.0:1788612792.329840:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612febbca80 x1875495932359680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612792.329851:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932359680:0@lo:400:kworker.0 00000100:00100000:1.0:1788612792.329863:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932359040:0@lo:400:kworker.0 00000100:00100000:2.0:1788612792.331754:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932360320:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788612792.334108:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788612792.334116:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9611c882e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788612792.334121:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788612792.334128:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9611c882e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612792.334133:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 550 00000100:00080000:1.0:1788612792.334158:0:3648:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9611c882e800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612792.334204:0:3648:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc76f480 x1875495932360448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788612792.334223:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932359552:0@lo:400:kworker.0 00000100:00100000:2.0:1788612792.337797:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612792.337852:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932360448:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788612792.337888:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612792.337941:0:20769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932360448 00000100:00100000:2.0:1788612792.337948:0:20769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932360448 00000100:00100000:2.0:1788612792.337998:0:20769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788612792.338005:0:20769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1875495932360448:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788612792.338022:0:20769:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788612792.338078:0:20769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1875495932360448:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 72us (189us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788612792.338085:0:20769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788612792.338121:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c882e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788612792.338126:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788612792.338130:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932360448:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788612792.340734:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932360320 00000100:00100000:1.0:1788612792.340747:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932360320 00000100:00100000:1.0:1788612792.340805:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788612792.340813:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875495932360320:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1788612792.340831:0:17203:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788612792.340912:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875495932360320:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 97us (3121us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788612792.340921:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788612792.341018:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c68fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788612792.341024:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788612792.341029:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932360320:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788612792.367931:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c815ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932360064:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 40178us (40687us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788612792.367947:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788612792.368411:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612c6ac1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788612792.368417:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788612792.368421:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932360064:0@lo:38:ptlrpcd_00_03.0 00000001:00100000:3.0:1788612792.816748:0:17178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788612792.816757:0:17178:0:(genops.c:885:class_export_put()) final put ffff9612d8ac9000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788612792.816771:0:17178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a37240e2-533b-4db0-8e7c-d76c26fe9abe 00000001:00080000:3.0:1788612792.816779:0:17178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:3.0:1788612792.816781:0:17178:0:(genops.c:885:class_export_put()) final put ffff9611c663d000/a37240e2-533b-4db0-8e7c-d76c26fe9abe 00000001:00100000:3.0:1788612792.816786:0:17178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a43cb079-defd-42bd-a3d5-1be09fd1336b 00000001:00080000:3.0:1788612792.816792:0:17178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00000080:3.0:1788612792.816797:0:17178:0:(genops.c:885:class_export_put()) final put ffff9612fb872000/a43cb079-defd-42bd-a3d5-1be09fd1336b 00000020:00000080:0.0:1788612792.817698:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612d8ac9000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788612792.817767:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c663d000/a37240e2-533b-4db0-8e7c-d76c26fe9abe for lustre-MDT0000 00000020:00000080:0.0:1788612792.817795:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fb872000/a43cb079-defd-42bd-a3d5-1be09fd1336b for lustre-MDT0000 00000020:00000080:0.0:1788612792.817823:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612c7662800 for lustre-MDT0000 00000020:00000080:0.0:1788612792.817827:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c663c800 for lustre-MDT0000 00000020:00000080:0.0:1788612792.817831:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612fb877800 for lustre-MDT0000 00010000:00010000:0.0:1788612793.264770:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788612793.328465:0:20767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9612fb8c7240 - data ffff9612ea686288/ffff9612fc75c400 00000020:01000000:0.0:1788612793.328653:0:20767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9611c6b443c0 - data ffff9612ea684948/ffff9612c7a9d800 00000001:00100000:3.0:1788612793.333355:0:17931:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788612793.333372:0:17931:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1788612793.333378:0:17931:0:(genops.c:885:class_export_put()) final put ffff9612e92bb800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788612793.333447:0:17931:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a37240e2-533b-4db0-8e7c-d76c26fe9abe 00000001:00080000:3.0:1788612793.333453:0:17931:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1788612793.333456:0:17931:0:(genops.c:885:class_export_put()) final put ffff9612e9525800/a37240e2-533b-4db0-8e7c-d76c26fe9abe 00000020:00000080:1.0:1788612793.333748:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9612e92bb800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788612793.333843:0:15779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612e92bd000 for lustre-MDT0001 00000001:00100000:3.0:1788612793.334299:0:17931:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a43cb079-defd-42bd-a3d5-1be09fd1336b 00000001:00080000:3.0:1788612793.334307:0:17931:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1788612793.334310:0:17931:0:(genops.c:885:class_export_put()) final put ffff9612d1e74800/a43cb079-defd-42bd-a3d5-1be09fd1336b 00000020:00000080:0.0:1788612793.334413:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612e9525800/a37240e2-533b-4db0-8e7c-d76c26fe9abe for lustre-MDT0001 00000020:00000080:0.0:1788612793.334458:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612d1e74800/a43cb079-defd-42bd-a3d5-1be09fd1336b for lustre-MDT0001 00000020:00000080:0.0:1788612793.334635:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612e9525000 for lustre-MDT0001 00000020:00000080:0.0:1788612793.334640:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612d1e73800 for lustre-MDT0001 00000001:00000004:0.0:1788612793.339409:0:20767:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00080000:3.0:1788612793.408156:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788612793.408164:0:20767:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788612793.408179:0:20767:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9612fc726680 x1875495932358528/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788612801 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612793.408205:0:20767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788612793.410250:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788612793.410258:0:20767:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1788612793.410279:0:20767:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788612793.410281:0:20767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788612793.410496:0:17222:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788612793.410501:0:17222:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:0.0:1788612793.410510:0:17222:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788612793.411554:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788612793.411560:0:20767:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1788612793.411572:0:20767:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788612793.411574:0:20767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788612793.411937:0:17224:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788612793.411942:0:17224:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:1.0:1788612793.411950:0:17224:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788612793.413174:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc90fa 00000020:00000080:3.0:1788612793.413183:0:20767:0:(genops.c:885:class_export_put()) final put ffff9611c6749800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788612793.413926:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c6749800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788612793.414614:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc910f 00000020:00000080:3.0:1788612793.414625:0:20767:0:(genops.c:885:class_export_put()) final put ffff96130168c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788612793.414638:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788612793.414643:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612793.414651:0:20767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788612793.414655:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9612fe9ecd40) has no exports 00000020:00000080:1.0:1788612793.414911:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff96130168c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1788612793.415029:0:20767:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788612793.415039:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9171 00000020:00000080:3.0:1788612793.415043:0:20767:0:(genops.c:885:class_export_put()) final put ffff9612e0943800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788612793.415065:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788612793.415069:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612793.415074:0:20767:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788612793.415076:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9612ea24cd40) has no exports 00000020:00000080:3.0:1788612793.415082:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc916a 00000020:00000080:3.0:1788612793.415085:0:20767:0:(genops.c:885:class_export_put()) final put ffff961300763000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788612793.415422:0:20767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788612793.415427:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788612793.415431:0:20767:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1788612793.415437:0:20767:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788612793.415439:0:20767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788612793.415471:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788612793.415501:0:20767:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788612793.415507:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc915c 00000020:00000080:3.0:1788612793.415513:0:20767:0:(genops.c:885:class_export_put()) final put ffff9612e0946000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788612793.415516:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788612793.415519:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612793.415522:0:20767:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788612793.415525:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9611c69d0000) has no exports 00000020:00000080:3.0:1788612793.415528:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9155 00000020:00000080:3.0:1788612793.415531:0:20767:0:(genops.c:885:class_export_put()) final put ffff961300764000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788612793.415795:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9612e0943800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788612793.415802:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff961300763000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788612793.415808:0:15779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961300767800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788612793.415814:0:15779:0:(genops.c:885:class_export_put()) final put ffff9612e0940000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788612793.415816:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9612e0940000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788612793.415820:0:15779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788612793.415895:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9612e0946000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788612793.415911:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff961300764000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788612793.417535:0:20767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788612793.417542:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788612793.417546:0:20767:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1788612793.417553:0:20767:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788612793.417555:0:20767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788612793.417602:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788612793.417612:0:20767:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788612793.417626:0:15779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961300767000 for lustre-OST0000-osc-MDT0000 00000004:01000000:3.0:1788612793.417627:0:20767:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788612793.417636:0:15779:0:(genops.c:885:class_export_put()) final put ffff961300764800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788612793.417639:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff961300764800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788612793.417642:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9147 00000020:01000000:1.0:1788612793.417644:0:15779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788612793.417648:0:20767:0:(genops.c:885:class_export_put()) final put ffff961300765000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788612793.417657:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788612793.417661:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612793.417666:0:20767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788612793.417670:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9612fcfc0000) has no exports 00000020:00000080:3.0:1788612793.417677:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9140 00000020:00000080:3.0:1788612793.417681:0:20767:0:(genops.c:885:class_export_put()) final put ffff9612f7af9800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788612793.417730:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff961300765000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788612793.417735:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9612f7af9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788612793.435558:0:20767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788612793.435567:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788612793.435571:0:20767:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788612793.435580:0:20767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788612793.435651:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612793.435663:0:20767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788612793.435691:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612793.435696:0:20767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788612793.435701:0:20767:0:(genops.c:885:class_export_put()) final put ffff9611c6749000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788612793.435705:0:20767:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c6749000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788612793.435731:0:20767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788612793.435833:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9116 00000020:00000080:0.0:1788612793.435840:0:20767:0:(genops.c:885:class_export_put()) final put ffff96130168d800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788612793.435844:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788612793.435848:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612793.435852:0:20767:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788612793.435856:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9612fe9e99c0) has no exports 00000020:00000080:0.0:1788612793.435874:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612793.435882:0:20767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788612793.435887:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc911d 00000020:00000080:0.0:1788612793.435892:0:20767:0:(genops.c:885:class_export_put()) final put ffff96130168b800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788612793.435897:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612f7afa800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788612793.435907:0:8:0:(genops.c:885:class_export_put()) final put ffff9612f7afa000/lustre-MDT0000-mdtlov_UUID 00000020:01000004:0.0:1788612793.435909:0:20767:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9611c816d000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788612793.435910:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612f7afa000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000004:0.0:1788612793.435914:0:20767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9611c816d000 3 00000020:01000004:0.0:1788612793.435919:0:20767:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9611c816d000 from lustre-MDT0000 00000020:01000000:1.0:1788612793.435921:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788612793.435938:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612793.435957:0:20767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788612793.435960:0:20767:0:(genops.c:885:class_export_put()) final put ffff9611c674a800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788612793.435963:0:20767:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c674a800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788612793.435973:0:20767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:1.0:1788612793.435983:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96130168d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788612793.435988:0:8:0:(genops.c:885:class_export_put()) final put ffff9611c674b800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788612793.435990:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c674b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788612793.435996:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1788612793.436011:0:20767:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788612793.436016:0:20767:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788612793.436019:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788612793.436023:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612793.436027:0:20767:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00000080:1.0:1788612793.436031:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96130168b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:0.0:1788612793.436034:0:20767:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9611c81b3000 d240c1fb-ce1c-496f-9994-daecd37f5c24 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788612793.436041:0:20767:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9611c5a24d40) has exports, disconnecting them 00000020:00080000:0.0:1788612793.436046:0:20767:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9611c81b3000), last request at 1788612703 00000020:00000080:0.0:1788612793.436073:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc90c2 00000020:00010000:0.0:1788612793.436077:0:20767:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9611c81b3000: total 0 00000100:00080000:0.0:1788612793.436081:0:20767:0:(import.c:65:import_set_state_nolock()) ffff9611c81b3800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788612793.436100:0:20767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9611c81b3000): rc 0 00000020:00080000:0.0:1788612793.436104:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9611c5a24d40) has no exports 00000020:00010000:1.0:1788612793.436152:0:17187:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9611c81b3000: total 0 00010000:00010000:1.0:1788612793.436176:0:17187:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9611c81b3000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788612793.436203:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9613020f4400/0x1f8616bf0bc9687 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc9680 expref: 14 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612793.436223:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2896200/0x1f8616bf0bc91fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc91f6 expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612793.436234:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c799be00/0x1f8616bf0bc94ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc94a4 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612793.436245:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c799aa00/0x1f8616bf0bc94ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc94e3 expref: 11 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612793.436269:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9695 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc968e expref: 10 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612793.436281:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c7240200/0x1f8616bf0bc9481 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc947a expref: 9 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612793.436292:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c7241200/0x1f8616bf0bc9323 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc931c expref: 8 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612793.436304:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a3200/0x1f8616bf0bc9679 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc9672 expref: 7 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612793.436315:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c799b600/0x1f8616bf0bc929e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc9297 expref: 6 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612793.436326:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c7240600/0x1f8616bf0bc91ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc91e8 expref: 5 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612793.436336:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c799ba00/0x1f8616bf0bc90d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc90c9 expref: 4 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612793.436345:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c7240c00/0x1f8616bf0bc91e1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc91da expref: 3 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612793.436356:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc934d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1f8616bf0bc9346 expref: 2 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612793.436366:0:17187:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9611c81b3000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788612793.436380:0:17187:0:(genops.c:885:class_export_put()) final put ffff9611c81b3000/d240c1fb-ce1c-496f-9994-daecd37f5c24 00010000:00010000:1.0:1788612793.436403:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612793.436411:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612793.436413:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612793.436469:0:17193:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9611c5932000:17193] 2 exiting: rc = 0 00000020:00000080:0.0:1788612793.436606:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c81b3000/d240c1fb-ce1c-496f-9994-daecd37f5c24 for MGS 00000020:00000080:0.0:1788612793.436631:0:15779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c81b3800 for MGS 00000100:00100000:0.0:1788612793.439599:0:17191:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9611c7868a00:17191] 0 exiting: rc = 1 00000100:00100000:3.0:1788612793.440430:0:17192:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9611c5932c00:17192] 1 exiting: rc = 0 00000100:00100000:0.0:1788612793.440548:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440562:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440650:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440663:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440669:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440675:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440680:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440685:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440701:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440708:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440713:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440718:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440743:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440749:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440754:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440760:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440902:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440910:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440916:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440921:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440927:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440932:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440937:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440943:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440948:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440953:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440958:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440964:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440969:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440974:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440980:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440986:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440992:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.440997:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441004:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441010:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441016:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441021:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441027:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441032:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441038:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441043:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441049:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441066:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441073:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441079:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441085:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441098:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441104:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441110:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441116:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441122:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441128:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441133:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441139:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441144:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441150:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441155:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441160:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441165:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441171:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441177:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441183:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612793.441189:0:20767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788612793.444413:0:20767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9611c77c00c0 - data ffff9611c5c4e288/ffff9611c8878400 00000020:01000000:0.0:1788612793.444566:0:20767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9611c7b41900 - data ffff9612ea47b948/ffff9612fe909000 00000020:00000080:0.0:1788612793.448251:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc90a6 00000020:00000080:0.0:1788612793.448265:0:20767:0:(genops.c:885:class_export_put()) final put ffff9611c816c000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788612793.448290:0:20767:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9611c816d000 from MGS, refs=2 00000020:01000004:0.0:1788612793.448293:0:20767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9611c816d000 2 00000020:01000004:0.0:1788612793.448297:0:20767:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9611c816d000 from MGS 00000020:00000080:0.0:1788612793.448320:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612793.448327:0:20767:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788612793.448330:0:20767:0:(genops.c:885:class_export_put()) final put ffff9611c8169000/MGS 00000020:00000080:0.0:1788612793.448333:0:20767:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c8169000/MGS for MGS 00000020:01000000:0.0:1788612793.448341:0:20767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788612793.448401:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788612793.448404:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612793.448409:0:20767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788612793.448416:0:20767:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff96130168e800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788612793.448421:0:20767:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9612fe9e8000) has exports, disconnecting them 00000020:00080000:0.0:1788612793.448435:0:20767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff96130168e800), last request at 1788612703 00000020:00000080:0.0:1788612793.448439:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc91a9 00000020:00080000:0.0:1788612793.448448:0:20767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96130168e800): rc 0 00000020:00000080:0.0:1788612793.448452:0:20767:0:(genops.c:885:class_export_put()) final put ffff96130168e800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788612793.449631:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c816c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788612793.449645:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96130168e800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788612793.450866:0:20767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788612793.450872:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788612793.450876:0:20767:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788612793.450882:0:20767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788612793.450908:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c674a000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788612793.451084:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788612793.451092:0:20767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788612793.451098:0:20767:0:(genops.c:885:class_export_put()) final put ffff9612e0944800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788612793.451102:0:20767:0:(genops.c:844:class_export_destroy()) destroying export ffff9612e0944800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788612793.451107:0:20767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788612793.451185:0:20767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9611c816d000 1 00000020:00000080:1.0:1788612793.451191:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9098 00000020:00000080:1.0:1788612793.451198:0:20767:0:(genops.c:885:class_export_put()) final put ffff9611c8168800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788612793.451205:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788612793.451213:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c8168800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788612793.451222:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788612793.451227:0:20767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788612793.451230:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9611c5a219c0) has no exports 00000020:00000080:0.0:1788612793.617311:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612793.617323:0:20767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788612793.617329:0:20767:0:(genops.c:885:class_export_put()) final put ffff9611c816d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788612793.617333:0:20767:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c816d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788612793.617343:0:20767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788612793.617453:0:20767:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9611c816f000 00000020:02000400:0.0:1788612793.617526:0:20767:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788612794.287814:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612795.315448:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612795.382373:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612795.382409:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932360576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788612795.382516:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612795.382561:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932360576 00000100:00100000:0.0:1788612795.382568:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932360576 00000100:00100000:0.0:1788612795.382622:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788612795.382631:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932360576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788612795.382658:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788612795.382698:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932360576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612795.382703:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788612795.382722:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612795.382756:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932360576:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788612796.337950:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788612796.404902:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788612796.404910:0:18701:0:(genops.c:885:class_export_put()) final put ffff9611c1097000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788612796.404935:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c1097000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788612796.404972:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c1091000 for lustre-OST0000 00000001:00100000:0.0:1788612796.407865:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788612796.407875:0:19518:0:(genops.c:885:class_export_put()) final put ffff9612d1e71000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788612796.412384:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9612d1e71000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788612796.412493:0:15779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612d1e71800 for lustre-OST0001 00000020:01000004:2.0:1788612797.273789:0:20969:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788612797.290928:0:20969:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788612797.290983:0:20969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240000/0x1f8616bf0bc9297 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc929e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.290998:0:20969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240000/0x1f8616bf0bc9297 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc929e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.291019:0:20969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240000/0x1f8616bf0bc9297 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc929e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.291035:0:20969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9612c7240000/0x1f8616bf0bc9297 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc929e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.291052:0:20969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788612797.291057:0:20969:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788612797.291094:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788612797.291098:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788612797.291105:0:20969:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788612797.291110:0:20969:0:(import.c:65:import_set_state_nolock()) ffff9611c8053000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788612797.291115:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788612797.291117:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788612797.291120:0:20969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788612797.291434:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612797.291443:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c7240000/0x1f8616bf0bc9297 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc929e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612797.291451:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240000 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:1.0:1788612797.291456:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c7240000/0x1f8616bf0bc9297 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc929e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612797.291465:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c7240000/0x1f8616bf0bc9297 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc929e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612797.291472:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c7240000/0x1f8616bf0bc9297 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc929e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612797.291510:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788612797.291513:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788612797.291515:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788612797.291563:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c7240000/0x1f8616bf0bc9297 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc929e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612797.291571:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612797.291599:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c7240000/0x1f8616bf0bc9297 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc929e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612797.291607:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c7240000/0x1f8616bf0bc9297 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc929e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612797.291620:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612797.291622:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612797.291623:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612797.291638:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788612797.291656:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932360704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788612797.291719:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612797.291780:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932360704 00000100:00100000:1.0:1788612797.291788:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932360704 00000100:00100000:1.0:1788612797.291828:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788612797.291847:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1875495932360704:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788612797.291854:0:17184:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788612797 with bad export cookie 141970504490455234 00010000:00010000:2.0:1788612797.292016:0:20969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36800/0x1f8616bf0bc91f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc91fd expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.292035:0:20969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36800/0x1f8616bf0bc91f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc91fd expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.292043:0:20969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36800/0x1f8616bf0bc91f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc91fd expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.292048:0:20969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9612f7b36800/0x1f8616bf0bc91f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc91fd expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.292059:0:20969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612797.292072:0:20969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2c00/0x1f8616bf0bc94e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc94ea expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.292079:0:20969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2c00/0x1f8616bf0bc94e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc94ea expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.292086:0:20969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2c00/0x1f8616bf0bc94e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc94ea expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.292093:0:20969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9611c67a2c00/0x1f8616bf0bc94e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc94ea expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.292104:0:20969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788612797.292109:0:20969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc968e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9695 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.292116:0:20969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc968e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9695 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.292122:0:20969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc968e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc9695 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.292129:0:20969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc968e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc9695 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.292136:0:20969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788612797.292141:0:20969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc91e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc91ef expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.292147:0:20969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc91e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc91ef expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.292159:0:20969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc91e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc91ef expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.292165:0:20969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc91e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc91ef expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612797.292172:0:20969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788612797.292174:0:20969:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788612797.292196:0:20969:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788612797.292199:0:20969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788612797.292203:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788612797.292208:0:20969:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788612797.292213:0:20969:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9611c5919000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788612797.292217:0:20969:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9611c1091800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788612797.292222:0:20969:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9612ea2499c0) has exports, disconnecting them 00000020:00080000:2.0:1788612797.292225:0:20969:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9611c5919000), last request at 1788612792 00000020:00000080:2.0:1788612797.292231:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc94d5 00000100:00080000:2.0:1788612797.292246:0:20969:0:(import.c:65:import_set_state_nolock()) ffff9611c5919800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788612797.292281:0:20969:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9611c5919000): rc 0 00000020:00000080:2.0:1788612797.292283:0:20969:0:(genops.c:885:class_export_put()) final put ffff9611c5919000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788612797.292292:0:20969:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9611c1091800), last request at 1788612792 00000020:00000080:2.0:1788612797.292294:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9377 00000100:00080000:2.0:1788612797.292299:0:20969:0:(import.c:65:import_set_state_nolock()) ffff9611c1094000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788612797.292304:0:20969:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9611c1091800): rc 0 00000020:00000080:2.0:1788612797.292305:0:20969:0:(genops.c:885:class_export_put()) final put ffff9611c1091800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788612797.292311:0:20969:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa9b940da3ae0 00000100:00080000:2.0:1788612797.292327:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788612797.292335:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788612797.295049:0:20969:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788612797.295059:0:20969:0:(import.c:65:import_set_state_nolock()) ffff9611c68fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1788612797.295263:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788612797.295273:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612f7b36800/0x1f8616bf0bc91f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc91fd expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.295284:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36800 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612797.295289:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b36800/0x1f8616bf0bc91f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc91fd expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.295301:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612f7b36800/0x1f8616bf0bc91f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc91fd expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612797.295309:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b36800/0x1f8616bf0bc91f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc91fd expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612797.295315:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788612797.295318:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1788612797.295321:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1788612797.295365:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612f7b36800/0x1f8616bf0bc91f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc91fd expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.295372:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612797.295414:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612f7b36800/0x1f8616bf0bc91f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc91fd expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.295422:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612f7b36800/0x1f8616bf0bc91f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc91fd expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.295434:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788612797.295437:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a2c00/0x1f8616bf0bc94e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc94ea expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.295444:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2c00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612797.295461:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2c00/0x1f8616bf0bc94e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc94ea expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.295468:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a2c00/0x1f8616bf0bc94e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc94ea expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612797.295473:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2c00/0x1f8616bf0bc94e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc94ea expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612797.295765:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788612797.295768:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788612797.295770:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788612797.295787:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9611c67a2c00/0x1f8616bf0bc94e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc94ea expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.295792:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612797.295799:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2c00/0x1f8616bf0bc94e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc94ea expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.295805:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a2c00/0x1f8616bf0bc94e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc94ea expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.295819:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612797.295823:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc968e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc9695 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.295828:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3600 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612797.295831:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc968e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc9695 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.295845:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc968e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc9695 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612797.295858:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc968e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc9695 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612797.295863:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788612797.295866:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788612797.295868:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788612797.295883:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc968e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc9695 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.295889:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612797.295909:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc968e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc9695 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.295917:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc968e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc9695 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.295926:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612797.295929:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc91e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc91ef expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.295935:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36600 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612797.295938:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc91e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc91ef expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.295945:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc91e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc91ef expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612797.295952:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc91e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc91ef expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612797.295967:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788612797.295969:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788612797.295971:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788612797.295984:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc91e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc91ef expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.295990:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612797.295996:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc91e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc91ef expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.296003:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc91e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1f8616bf0bc91ef expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612797.296015:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612797.296017:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612797.296019:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612797.296053:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932360960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612797.296117:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612797.296162:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612797.296169:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932360832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612797.296191:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612797.296234:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932360960 00000100:00100000:0.0:1788612797.296242:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932360960 00000100:00100000:0.0:1788612797.296267:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932360832 00000100:00100000:0.0:1788612797.296269:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932360832 00000100:00100000:0.0:1788612797.296282:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788612797.296289:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3651:x1875495932360960:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788612797.296295:0:17185:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788612797 with bad export cookie 141970504490455234 00000100:00100000:0.0:1788612797.296348:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3651:x1875495932360960:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (230us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788612797.296355:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788612797.296372:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788612797.296375:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3651:x1875495932360832:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788612797.296379:0:17185:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788612797 with bad export cookie 141970504490455234 00000100:00100000:0.0:1788612797.296403:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3651:x1875495932360832:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (211us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788612797.296409:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788612797.296429:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d240c1fb-ce1c-496f-9994-daecd37f5c24:3649:1875495932361216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612797.296452:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612797.296468:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612797.296474:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d240c1fb-ce1c-496f-9994-daecd37f5c24:3649:1875495932361088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612797.296519:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788612797.300227:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788612797.300235:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788612797.303694:0:20969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788612797.303756:0:20969:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788612797.303786:0:20969:0:(import.c:65:import_set_state_nolock()) ffff9611c78b1000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788612797.303809:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788612797.303813:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788612797.303824:0:20969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788612797.303899:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932361344:0@lo:9:umount.0 00000100:00100000:2.0:1788612797.304010:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788612797.304203:0:20969:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788612797.304216:0:20969:0:(import.c:65:import_set_state_nolock()) ffff9612fccfd800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788612797.304234:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932361472:0@lo:9:umount.0 00000100:00100000:2.0:1788612797.304257:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788612797.304321:0:20969:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9612ea2499c0) has no exports 00000100:00100000:3.0:1788612797.304438:0:19152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932361344 00000100:00100000:3.0:1788612797.304447:0:19152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932361344 00000100:00100000:3.0:1788612797.304513:0:19152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932361472 00000100:00100000:3.0:1788612797.304516:0:19152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932361472 00000100:00100000:3.0:1788612797.304554:0:19152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788612797.304564:0:19152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875495932361344:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788612797.304589:0:19152:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc93a1 00000100:00080000:3.0:1788612797.304599:0:19152:0:(import.c:65:import_set_state_nolock()) ffff9611c1092800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788612797.304641:0:19152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788612797.304799:0:19152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3647:x1875495932361344:12345-0@lo:9:umount.0 Request processed in 237us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612797.304807:0:19152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788612797.304822:0:19152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788612797.304828:0:19152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875495932361472:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788612797.304840:0:19152:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9506 00000100:00080000:3.0:1788612797.304845:0:19152:0:(import.c:65:import_set_state_nolock()) ffff9612d1e70800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788612797.304860:0:19152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788612797.304935:0:19152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3647:x1875495932361472:12345-0@lo:9:umount.0 Request processed in 107us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612797.304942:0:19152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788612797.305054:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:0:1875495932361600:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788612797.305082:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612fccfd800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788612797.305149:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788612797.305217:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788612797.305221:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932361472:0@lo:9:umount.0 00000100:00080000:2.0:1788612797.305237:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c78b1000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788612797.305241:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788612797.305242:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788612797.305244:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932361344:0@lo:9:umount.0 00000100:00080000:2.0:1788612797.305591:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788612797.305594:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612797.305627:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788612797.305631:0:3651:0:(import.c:65:import_set_state_nolock()) ffff96130066d800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788612797.305635:0:3651:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1788612797.307096:0:20223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932361216 00000100:00100000:0.0:1788612797.307110:0:20223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932361216 00000100:00100000:0.0:1788612797.307144:0:20223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932361088 00000100:00100000:0.0:1788612797.307148:0:20223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932361088 00000100:00100000:0.0:1788612797.307166:0:20223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788612797.307176:0:20223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1875495932361216:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788612797.307185:0:20223:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788612797 with bad export cookie 141970504490455234 00000100:00100000:0.0:1788612797.307299:0:20223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1875495932361216:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (10843us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788612797.307342:0:20223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788612797.307363:0:20223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788612797.307369:0:20223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c13e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1875495932361088:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788612797.307374:0:20223:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788612797 with bad export cookie 141970504490455234 00000100:00100000:0.0:1788612797.307423:0:20223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c13e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1875495932361088:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (10901us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788612797.307428:0:20223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788612797.307468:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788612797.307677:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:00000080:0.0:1788612797.308114:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c5919000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1788612797.308165:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c1091800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788612797.308184:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c5919800 for lustre-MDT0001 00000020:00000080:0.0:1788612797.308189:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c1094000 for lustre-MDT0001 00010000:00010000:0.0:1788612797.308737:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612797.315187:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1875495932360704:12345-0@lo:103:ldlm_bl.0 Request processed in 23333us (23461us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788612797.315204:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788612797.324660:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788612797.347116:0:3651:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.130@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788612797.347122:0:3651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788612797.347132:0:3651:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9612fc76d180 x1875495932360704/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788612813 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612797.347148:0:3651:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9612febbc000 x1875495932360960/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788612813 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612797.347157:0:3651:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9612febbea00 x1875495932360832/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788612813 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612797.347166:0:3651:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9612febbfb80 x1875495932361216/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788612813 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612797.347176:0:3651:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9612febbd180 x1875495932361088/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788612813 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788612797.347186:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788612797.347189:0:3651:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788612797.347190:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788612797.347727:0:3649:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96130066d800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788612797.347756:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d240c1fb-ce1c-496f-9994-daecd37f5c24:3649:1875495932361216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612797.347788:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d240c1fb-ce1c-496f-9994-daecd37f5c24:3649:1875495932361088:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788612797.351736:0:3651:0:(import.c:65:import_set_state_nolock()) ffff96130066d800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788612797.351749:0:3651:0:(import.c:545:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 517 00000100:00080000:2.0:1788612797.351760:0:3651:0:(import.c:665:import_select_connection()) MGC192.168.203.130@tcp: import ffff96130066d800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788612797.352162:0:3651:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fccc5180 x1875495932361728/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788612797.352218:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932360960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612797.352245:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d240c1fb-ce1c-496f-9994-daecd37f5c24:3651:1875495932360832:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788612797.352592:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96130066d800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788612797.352721:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d240c1fb-ce1c-496f-9994-daecd37f5c24:3648:1875495932360704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612797.353008:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d240c1fb-ce1c-496f-9994-daecd37f5c24:3647:1875495932361728:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1788612797.353069:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875495932361728 offset 0 length 520: 4 00000020:00080000:3.0:1788612797.359330:0:20969:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9612ea2499c0) has no exports 00010000:00010000:0.0:1788612797.378114:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788612797.427951:0:20969:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9611c64cbc00 - data ffff9612ea61a798/ffff9611c18a1000 00000020:01000000:2.0:1788612797.428138:0:20969:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9611c7b41e40 - data ffff9612ea552d80/ffff9612e9075400 00000100:00080000:1.0:1788612797.428215:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788612797.428221:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788612797.428225:0:36:0:(import.c:65:import_set_state_nolock()) ffff9611c882e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612797.428234:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 606 00000100:00080000:1.0:1788612797.428241:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788612797.428248:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9611c882e800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612797.428287:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc76c700 x1875495932361856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788612797.428340:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788612797.428343:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788612797.428345:0:36:0:(import.c:65:import_set_state_nolock()) ffff9612c6ac1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612797.428350:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 606 00000100:00080000:1.0:1788612797.428353:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788612797.428364:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9612c6ac1800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612797.428379:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc76f800 x1875495932362112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788612797.428425:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612797.428442:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932361984:0@lo:400:kworker.0 00000100:00100000:1.0:1788612797.428586:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612797.428637:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932361984 00000100:00100000:1.0:1788612797.428644:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932361984 00000100:00100000:1.0:1788612797.428695:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788612797.428708:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1875495932361984:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788612797.428716:0:17200:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788612797.428756:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1875495932361984:12345-0@lo:400:kworker.0 Request processed in 52us (171us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788612797.428888:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932361856:0@lo:38:kworker.0 00000100:00100000:3.0:1788612797.428920:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612797.428945:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932362112:0@lo:38:kworker.0 00000100:00100000:3.0:1788612797.428965:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612797.429104:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612797.429115:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932362240:0@lo:400:kworker.0 00000100:00100000:0.0:1788612797.429142:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788612797.429190:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788612797.429195:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9611c7524800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788612797.429198:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788612797.432251:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932361856 00000100:00100000:3.0:1788612797.432266:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932361856 00000100:00100000:2.0:1788612797.433059:0:20769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932362112 00000100:00100000:2.0:1788612797.433066:0:20769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932362112 00000100:00100000:2.0:1788612797.433083:0:20769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932362240 00000100:00100000:2.0:1788612797.433087:0:20769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932362240 00000100:00100000:2.0:1788612797.433101:0:20769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788612797.433109:0:20769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1875495932362112:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788612797.433133:0:20769:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788612797.437686:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788612797.437737:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788612797.437746:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875495932362240:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788612797.437756:0:17200:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788612797.437850:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875495932362240:12345-0@lo:400:kworker.0 Request processed in 103us (8706us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788612797.437857:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1788612797.437907:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788612797.437912:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9611c663f000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788612797.437916:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788612797.437922:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9611c663f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612797.437926:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 565 00000100:00080000:1.0:1788612797.437933:0:3649:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9611c663f000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612797.437976:0:3649:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc76d180 x1875495932362368/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788612797.438000:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875495932362240:0@lo:400:kworker.0 00000100:00100000:1.0:1788612797.438046:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875495932362368:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788612797.438083:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612797.438194:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932362368 00000100:00100000:1.0:1788612797.438201:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932362368 00000100:00100000:1.0:1788612797.438223:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788612797.438228:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932362368:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1788612797.438243:0:17200:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788612797.438277:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932362368:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 48us (194us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788612797.438284:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1788612797.438309:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c663f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788612797.438314:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788612797.438317:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875495932362368:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1788612797.442920:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9611c7524800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788612797.442930:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 550 00000100:00080000:0.0:1788612797.442939:0:3650:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9611c7524800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612797.442975:0:3650:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612febbf800 x1875495932362496/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612797.443009:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932361984:0@lo:400:kworker.0 00000100:00100000:0.0:1788612797.443066:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875495932362496:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788612797.443126:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612797.443182:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932362496 00000100:00100000:0.0:1788612797.443188:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932362496 00000100:00100000:0.0:1788612797.443223:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788612797.443230:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932362496:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1788612797.443246:0:17200:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788612797.443281:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932362496:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 51us (154us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788612797.443288:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1788612797.443320:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c7524800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612797.443324:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788612797.443327:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875495932362496:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788612797.443941:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788612797.443948:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932361856:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788612797.443960:0:17198:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788612797.443997:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932361856:12345-0@lo:38:kworker.0 Request processed in 48us (15076us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788612797.444002:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1788612797.444392:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c882e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612797.444398:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788612797.444401:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932361856:0@lo:38:kworker.0 00000100:00100000:2.0:1788612797.475888:0:20769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1875495932362112:12345-0@lo:38:kworker.0 Request processed in 42770us (46912us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788612797.475901:0:20769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788612797.476184:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612c6ac1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788612797.476191:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788612797.476195:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932362112:0@lo:38:kworker.0 00000001:00000004:1.0:1788612797.482745:0:20969:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1788612797.532787:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788612797.532795:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788612797.532803:0:20969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788612797.539795:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788612797.539802:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788612797.539823:0:20969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788612797.539827:0:20969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788612797.540169:0:17940:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788612797.540174:0:17940:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1788612797.540183:0:17940:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788612797.549125:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788612797.549133:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788612797.549147:0:20969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788612797.549150:0:20969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788612797.549451:0:17942:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788612797.549456:0:17942:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1788612797.549466:0:17942:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788612797.553393:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc920b 00000020:00000080:3.0:1788612797.553404:0:20969:0:(genops.c:885:class_export_put()) final put ffff96130168c000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788612797.553563:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96130168c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788612797.554595:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9220 00000020:00000080:3.0:1788612797.554604:0:20969:0:(genops.c:885:class_export_put()) final put ffff9611c68fc000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788612797.554621:0:20969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788612797.554637:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612797.554646:0:20969:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788612797.554663:0:20969:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9612ea24b380) has no exports 00000004:01000000:3.0:1788612797.554802:0:20969:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788612797.554811:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9274 00000020:00000080:3.0:1788612797.554816:0:20969:0:(genops.c:885:class_export_put()) final put ffff9611c78b2000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788612797.554820:0:20969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788612797.554823:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612797.554828:0:20969:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788612797.554830:0:20969:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9612d1e619c0) has no exports 00000020:00000080:3.0:1788612797.554835:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc926d 00000020:00000080:3.0:1788612797.554839:0:20969:0:(genops.c:885:class_export_put()) final put ffff9612fccfd000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788612797.555145:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c68fc000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1788612797.555155:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c78b2000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788612797.555163:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9612fccfd000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788612797.555190:0:20969:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788612797.555195:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788612797.555199:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788612797.555204:0:20969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788612797.555206:0:20969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788612797.555246:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612797.555248:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612fccfd800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788612797.555252:0:20969:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788612797.555257:0:20969:0:(genops.c:885:class_export_put()) final put ffff9612c8097800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788612797.555260:0:20969:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c8097800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788612797.555265:0:20969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788612797.555338:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc925f 00000020:00000080:3.0:1788612797.555343:0:20969:0:(genops.c:885:class_export_put()) final put ffff9612c8093800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788612797.555357:0:20969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788612797.555361:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612797.555364:0:20969:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788612797.555367:0:20969:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9612fcfc3380) has no exports 00000020:00000080:3.0:1788612797.555371:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9258 00000020:00000080:3.0:1788612797.555374:0:20969:0:(genops.c:885:class_export_put()) final put ffff9611c78b7800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788612797.555417:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c8093800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788612797.555433:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c78b7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788612797.560651:0:20969:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788612797.560659:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788612797.560675:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788612797.560682:0:20969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788612797.560685:0:20969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788612797.560738:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c78b1000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788612797.560743:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788612797.560754:0:20969:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788612797.560760:0:20969:0:(genops.c:885:class_export_put()) final put ffff9611c78b0000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788612797.560764:0:20969:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c78b0000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788612797.560770:0:20969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788612797.561367:0:20969:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788612797.561377:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9243 00000020:00000080:3.0:1788612797.561384:0:20969:0:(genops.c:885:class_export_put()) final put ffff9611c78b6800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788612797.561401:0:20969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788612797.561406:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612797.561413:0:20969:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788612797.561417:0:20969:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9611c64b99c0) has no exports 00000020:00000080:3.0:1788612797.561423:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc923c 00000020:00000080:3.0:1788612797.561428:0:20969:0:(genops.c:885:class_export_put()) final put ffff9611c68f9000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788612797.561531:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c78b6800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788612797.561544:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c68f9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788612797.567550:0:20969:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788612797.567559:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788612797.567564:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788612797.567572:0:20969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788612797.567615:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612797.567625:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c68fe000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788612797.567627:0:20969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788612797.567638:0:36:0:(genops.c:885:class_export_put()) final put ffff9611c68f8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788612797.567641:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c68f8800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1788612797.567648:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788612797.567678:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788612797.567692:0:20969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788612797.567697:0:20969:0:(genops.c:885:class_export_put()) final put ffff9611c6494800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788612797.567699:0:20969:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c6494800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788612797.567704:0:20969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788612797.568607:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9227 00000020:00000080:2.0:1788612797.568617:0:20969:0:(genops.c:885:class_export_put()) final put ffff9611c68ff800/lustre-MDD0001_UUID 00000020:01000000:2.0:1788612797.568626:0:20969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788612797.568631:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788612797.568637:0:20969:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788612797.568641:0:20969:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9612ea248000) has no exports 00000020:00000080:2.0:1788612797.568663:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788612797.568667:0:20969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788612797.568670:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc922e 00000020:00000080:2.0:1788612797.568673:0:20969:0:(genops.c:885:class_export_put()) final put ffff9611c68fa800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788612797.568681:0:20969:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9612c82bd800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788612797.568684:0:20969:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9612c82bd800 2 00000020:01000004:2.0:1788612797.568687:0:20969:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9612c82bd800 from lustre-MDT0001 00000020:00000080:2.0:1788612797.568705:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788612797.568708:0:20969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788612797.568711:0:20969:0:(genops.c:885:class_export_put()) final put ffff9612e0945000/lustre-MDT0001_UUID 00000020:00000080:2.0:1788612797.568713:0:20969:0:(genops.c:844:class_export_destroy()) destroying export ffff9612e0945000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788612797.568721:0:20969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:00000080:0.0:1788612797.568723:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c68ff800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1788612797.568729:0:36:0:(genops.c:885:class_export_put()) final put ffff9612f7af8000/lustre-MDD0001_UUID 00000020:00000080:0.0:1788612797.568732:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9612f7af8000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1788612797.568736:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:2.0:1788612797.568764:0:20969:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788612797.568769:0:20969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788612797.568773:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788612797.568779:0:20969:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788612797.568785:0:20969:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9611c8050800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788612797.568790:0:20969:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9611c69d19c0) has exports, disconnecting them 00000020:00080000:2.0:1788612797.568795:0:20969:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9611c8050800), last request at 1788612718 00000020:00000080:2.0:1788612797.568799:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc92ac 00000020:00080000:2.0:1788612797.568813:0:20969:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9611c8050800): rc 0 00000020:00000080:2.0:1788612797.568823:0:20969:0:(genops.c:885:class_export_put()) final put ffff9611c8050800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788612797.568864:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c68fa800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788612797.568871:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c8050800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1788612797.582579:0:20969:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788612797.582588:0:20969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788612797.582592:0:20969:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788612797.582600:0:20969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788612797.582627:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c8053000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788612797.582793:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612797.582802:0:20969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1788612797.582807:0:20969:0:(genops.c:885:class_export_put()) final put ffff9611c7a6d800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788612797.582811:0:20969:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c7a6d800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788612797.582818:0:20969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788612797.582882:0:20969:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9612c82bd800 1 00000020:00000080:0.0:1788612797.582889:0:20969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc91d3 00000020:00000080:0.0:1788612797.582895:0:20969:0:(genops.c:885:class_export_put()) final put ffff9611c67e7800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1788612797.582904:0:20969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788612797.582912:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c67e7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788612797.582945:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612797.582950:0:20969:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788612797.582954:0:20969:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9612d1e64d40) has no exports 00000020:00000080:0.0:1788612797.785307:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612797.785320:0:20969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788612797.785326:0:20969:0:(genops.c:885:class_export_put()) final put ffff9612c82bc800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788612797.785330:0:20969:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c82bc800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788612797.785336:0:20969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788612797.785449:0:20969:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9612c82bd000 00000020:01000000:0.0:1788612797.785468:0:20969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788612797.785471:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612797.785736:0:20969:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788612797.785741:0:20969:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9611c69d3380) has no exports 00000100:00100000:2.0:1788612797.786703:0:20193:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9612e807ea00:20193] 3 exiting: rc = 0 00000100:00100000:2.0:1788612797.787605:0:17199:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9611c64a1000:17199] 1 exiting: rc = 0 00000100:00100000:2.0:1788612797.788588:0:20769:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9611c64ad000:20769] 4 exiting: rc = 0 00000100:00100000:3.0:1788612797.789101:0:17198:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9611c5933c00:17198] 0 exiting: rc = 1 00000100:00100000:0.0:1788612797.792958:0:17200:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9611c64a1200:17200] 2 exiting: rc = 0 00000100:00100000:3.0:1788612797.801116:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801126:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801132:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801139:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801145:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801151:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801156:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801163:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801168:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801174:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801179:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801184:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801191:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801197:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801204:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801224:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801229:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801234:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801240:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801246:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801252:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801258:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801265:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801270:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801276:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801282:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801287:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.801291:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802069:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802081:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802087:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802093:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802098:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802102:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802108:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802240:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802246:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802252:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802258:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802263:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802269:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802274:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802279:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802285:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802290:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802297:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802304:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802310:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802315:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802321:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802335:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802342:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802347:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802353:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802358:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802363:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802369:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802375:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802379:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802385:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802391:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802397:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802402:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.802408:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.815264:0:17202:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9612ec09c800:17202] 1 exiting: rc = 0 00000100:00100000:2.0:1788612797.815404:0:17201:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9612ec09dc00:17201] 0 exiting: rc = 1 00000100:00100000:3.0:1788612797.817093:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817103:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817111:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817116:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817121:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817127:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817132:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817137:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817141:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817146:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817150:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817155:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817160:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817165:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817170:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817176:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817181:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817186:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817191:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817197:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817215:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817219:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817224:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817228:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817232:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817237:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817242:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817247:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817252:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817257:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817262:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817267:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817272:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817277:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817282:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817287:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817292:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817296:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817300:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817305:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817310:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817314:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817319:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817324:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817329:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817334:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817340:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817345:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817351:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817356:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817360:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817364:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817369:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817373:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817377:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817389:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817394:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817398:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817403:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817408:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817413:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817418:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817422:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.817427:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.820377:0:17939:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9611c64a3600:17939] 2 exiting: rc = 0 00000100:00100000:3.0:1788612797.822862:0:17204:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9612fb8ef000:17204] 1 exiting: rc = 0 00000100:00100000:1.0:1788612797.825206:0:17203:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9611c7b35600:17203] 0 exiting: rc = 1 00000100:00100000:3.0:1788612797.827926:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.827953:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.827961:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.827967:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.827974:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.827981:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.827986:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.827993:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828033:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828044:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828049:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828055:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828061:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828067:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828072:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828078:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828084:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828090:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828097:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828104:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828127:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828134:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828140:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828145:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828162:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828169:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828174:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828181:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828186:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828192:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828198:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828203:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828223:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828232:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828239:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828245:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828252:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828258:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828264:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828272:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828277:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828284:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828289:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828295:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828316:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828323:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828330:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828335:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828342:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828347:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828353:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828360:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828365:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828371:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828377:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828383:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828403:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828411:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828416:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828429:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828435:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828441:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828447:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612797.828454:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.850800:0:17205:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9611c7942400:17205] 0 exiting: rc = 1 00000100:00100000:0.0:1788612797.850903:0:17206:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9612fb8eee00:17206] 1 exiting: rc = 0 00000100:00100000:2.0:1788612797.851082:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851090:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851096:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851102:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851108:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851113:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851118:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851124:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851130:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851135:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851141:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851147:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851152:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851158:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851165:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851171:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851176:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851182:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851192:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851198:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851205:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851211:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851217:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851222:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851227:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851232:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851238:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851244:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851249:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851266:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851272:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851278:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851284:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851289:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851295:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851301:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851307:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851312:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851318:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851324:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851330:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851336:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851341:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851347:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851352:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851358:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851364:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851369:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851375:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851380:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851386:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851392:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851397:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851402:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851408:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851413:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851418:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851424:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851430:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851436:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851442:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851447:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851453:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.851459:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.853867:0:17208:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9611c75d0c00:17208] 1 exiting: rc = 0 00000100:00100000:2.0:1788612797.854749:0:17207:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9611c75d1000:17207] 0 exiting: rc = 1 00000100:00100000:0.0:1788612797.855388:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855395:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855400:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855405:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855410:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855415:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855421:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855426:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855431:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855436:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855442:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855447:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855452:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855456:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855461:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855465:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855499:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855506:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855513:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855520:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855526:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855531:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855536:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855542:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855550:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855556:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855561:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855566:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855571:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855575:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855580:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855585:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855590:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855595:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855600:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855606:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855611:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855617:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855623:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855628:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855633:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855639:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855643:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855649:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855654:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855659:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855664:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855669:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855675:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855680:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855685:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855696:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855702:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855707:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855713:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855718:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855723:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855728:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855734:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855739:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855744:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855748:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855753:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.855758:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612797.857094:0:17210:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9612e2178e00:17210] 1 exiting: rc = 0 00000100:00100000:3.0:1788612797.857657:0:17209:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9612d125ec00:17209] 0 exiting: rc = 1 00000100:00100000:0.0:1788612797.857767:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857774:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857780:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857785:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857790:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857794:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857799:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857803:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857808:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857812:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857817:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857823:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857828:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857833:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857837:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857842:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857846:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857851:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857856:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857861:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857865:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857869:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857885:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857890:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857895:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857900:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857904:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857908:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857913:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857917:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857922:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857927:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857932:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857937:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857944:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857949:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857964:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857970:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857975:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857981:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857985:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857991:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.857997:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858002:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858006:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858011:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858015:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858020:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858035:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858040:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858045:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858049:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858054:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858058:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858063:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858067:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858071:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858084:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858089:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858093:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858098:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858103:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858109:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858114:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.858597:0:17213:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9611c67b9a00:17213] 2 exiting: rc = 0 00000100:00100000:2.0:1788612797.858999:0:17211:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9612febd1c00:17211] 0 exiting: rc = 1 00000100:00100000:3.0:1788612797.859206:0:17212:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9611c139aa00:17212] 1 exiting: rc = 0 00000100:00100000:0.0:1788612797.861321:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861346:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861493:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861500:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861505:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861510:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861515:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861520:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861524:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861530:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861553:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861559:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861564:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861570:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861575:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861581:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861587:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861593:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861598:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861603:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861608:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861613:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861619:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861624:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861629:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861634:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861640:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861660:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861666:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861672:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861690:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861696:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861703:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861709:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861728:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861735:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861741:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861747:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861753:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861758:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861764:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861770:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861776:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861783:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861789:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861795:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861800:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861806:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861813:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861819:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861825:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861830:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861835:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861841:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861847:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861853:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861859:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861865:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861871:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861876:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861882:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861887:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861901:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612797.861906:0:20969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788612797.868522:0:20969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612797.868535:0:20969:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788612797.868541:0:20969:0:(genops.c:885:class_export_put()) final put ffff9612c7194800/MDS_uuid 00000020:00000080:0.0:1788612797.868545:0:20969:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c7194800/MDS_uuid for MDS 00000020:01000000:0.0:1788612797.868552:0:20969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788612797.868748:0:20969:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788612798.384676:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612799.408684:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612800.434933:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612801.466871:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788612801.495933:0:21171:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788612801.515093:0:21171:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788612801.515147:0:21171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240800/0x1f8616bf0bc9346 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc934d expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612801.515161:0:21171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240800/0x1f8616bf0bc9346 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc934d expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612801.515169:0:21171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c7240800/0x1f8616bf0bc9346 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc934d expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612801.515177:0:21171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9612c7240800/0x1f8616bf0bc9346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc934d expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612801.515194:0:21171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788612801.515200:0:21171:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788612801.515225:0:21171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788612801.515230:0:21171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788612801.515235:0:21171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788612801.515241:0:21171:0:(import.c:65:import_set_state_nolock()) ffff9611c882e800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788612801.515246:0:21171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788612801.515247:0:21171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788612801.515251:0:21171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788612801.515991:0:21171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788612801.516008:0:21171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788612801.516012:0:21171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788612801.516015:0:21171:0:(import.c:65:import_set_state_nolock()) ffff9611c7524800 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788612801.516031:0:21171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788612801.516033:0:21171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788612801.516035:0:21171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788612801.516884:0:21171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c799b200/0x1f8616bf0bc931c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9323 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612801.516898:0:21171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c799b200/0x1f8616bf0bc931c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9323 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612801.516905:0:21171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c799b200/0x1f8616bf0bc931c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc9323 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612801.516911:0:21171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9611c799b200/0x1f8616bf0bc931c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc9323 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612801.516930:0:21171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788612801.516937:0:21171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc9680 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9687 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612801.516943:0:21171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc9680 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9687 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612801.516948:0:21171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc9680 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc9687 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612801.516954:0:21171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc9680 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc9687 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612801.516962:0:21171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1788612801.516965:0:21171:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788612801.517008:0:21171:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788612801.517012:0:21171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788612801.517016:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788612801.517021:0:21171:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788612801.517028:0:21171:0:(genops.c:1819:print_export_data()) lustre-OST0000: UNLINKED ffff9611c1095800 lustre-MDT0001-mdtlov_UUID 0@lo 1 (0 1 0) 1 0 0 0: 0000000000000000 8589934593 stale:0 00000020:00080000:2.0:1788612801.517034:0:21171:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9611c69d4d40) has no exports 00000020:00080000:2.0:1788612801.517055:0:21171:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9611c69d4d40) has no exports 00010000:00010000:3.0:1788612801.518083:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788612801.518092:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c7240800/0x1f8616bf0bc9346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc934d expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612801.518101:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240800 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612801.518105:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c7240800/0x1f8616bf0bc9346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc934d expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612801.518114:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c7240800/0x1f8616bf0bc9346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc934d expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612801.518122:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c7240800/0x1f8616bf0bc9346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc934d expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612801.518128:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788612801.518131:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788612801.518133:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788612801.518150:0:17186:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96130066d800 00010000:00010000:3.0:1788612801.518153:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c7240800/0x1f8616bf0bc9346 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc934d expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612801.518160:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c7240800/0x1f8616bf0bc9346 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc934d expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612801.518174:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612801.518188:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c799b200/0x1f8616bf0bc931c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc9323 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612801.518193:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b200 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612801.518196:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c799b200/0x1f8616bf0bc931c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc9323 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612801.518202:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c799b200/0x1f8616bf0bc931c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc9323 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612801.518209:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c799b200/0x1f8616bf0bc931c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc9323 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612801.518214:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788612801.518216:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788612801.518218:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788612801.518226:0:17186:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96130066d800 00010000:00010000:3.0:1788612801.518229:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c799b200/0x1f8616bf0bc931c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc9323 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612801.518234:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c799b200/0x1f8616bf0bc931c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc9323 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612801.518242:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612801.518245:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc9680 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc9687 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612801.518251:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2600 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612801.518253:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc9680 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc9687 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612801.518270:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc9680 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc9687 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612801.518275:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc9680 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc9687 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612801.518279:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788612801.518281:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788612801.518283:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788612801.518289:0:17186:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96130066d800 00010000:00010000:3.0:1788612801.518292:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc9680 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc9687 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612801.518297:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a2600/0x1f8616bf0bc9680 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc9687 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612801.518305:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612801.518307:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612801.518308:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612801.519449:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612802.479780:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788612802.543872:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) d240c1fb-ce1c-496f-9994-daecd37f5c24->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788612802.543883:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) d240c1fb-ce1c-496f-9994-daecd37f5c24->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612802.543886:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788612802.543890:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788612802.543895:0:8:0:(import.c:65:import_set_state_nolock()) ffff9612c6ac1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788612802.543903:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 611 00000100:00080000:0.0:1788612802.543909:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788612802.543917:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9612c6ac1800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612802.543954:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612febbf800 x1875495932362624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788612802.544007:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788612802.544012:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788612802.544014:0:8:0:(import.c:65:import_set_state_nolock()) ffff9611c663f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788612802.544017:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 611 00000100:00080000:0.0:1788612802.544020:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788612802.544032:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9611c663f000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612802.544047:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612febbc000 x1875495932362752/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788612802.544347:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932362624:0@lo:38:kworker.0 00000400:00000100:2.0:1788612802.544398:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875495932362624 offset 0 length 520: 4 00000100:00100000:2.0:1788612802.544451:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875495932362752:0@lo:38:kworker.0 00000400:00000100:2.0:1788612802.544468:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875495932362752 offset 0 length 520: 4 00000001:00100000:2.0:1788612802.545497:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788612802.545503:0:19518:0:(genops.c:885:class_export_put()) final put ffff9612d1e72800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788612802.545566:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9612d1e72800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788612802.545618:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612d1e70800 for lustre-OST0001 00000001:00100000:1.0:1788612802.546272:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788612802.546277:0:18701:0:(genops.c:885:class_export_put()) final put ffff9611c1095800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788612802.546351:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c1095800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788612802.546390:0:15779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c1092800 for lustre-OST0000 00010000:00010000:0.0:1788612803.503760:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788612803.568163:0:21171:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9611c6422ae0 - data ffff9612ea40da20/ffff9612fc745c00 00000020:01000000:3.0:1788612803.568303:0:21171:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9611c7b41a80 - data ffff9612ea69b948/ffff9612c7b62400 00100000:10000000:3.0:1788612803.580029:0:21171:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788612803.586241:0:21171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9331 00000020:00000080:2.0:1788612803.586252:0:21171:0:(genops.c:885:class_export_put()) final put ffff9611c7a6f800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788612803.586271:0:21171:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9612fe89a000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788612803.586275:0:21171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9612fe89a000 2 00000020:01000004:2.0:1788612803.586278:0:21171:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9612fe89a000 from lustre-OST0000 00000020:00000080:2.0:1788612803.586300:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788612803.586309:0:21171:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788612803.586311:0:21171:0:(genops.c:885:class_export_put()) final put ffff9611c7a68800/lustre-OST0000_UUID 00000020:00000080:2.0:1788612803.586314:0:21171:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c7a68800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788612803.586329:0:21171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788612803.586371:0:21171:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788612803.586375:0:21171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788612803.586378:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788612803.586382:0:21171:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788612803.586396:0:21171:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9611c882c000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788612803.586402:0:21171:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9612fb85cd40) has exports, disconnecting them 00000020:00080000:2.0:1788612803.586406:0:21171:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9611c882c000), last request at 1788612735 00000020:00000080:2.0:1788612803.586410:0:21171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc935b 00000020:00080000:2.0:1788612803.586707:0:21171:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9611c882c000): rc 0 00000020:00000080:2.0:1788612803.586713:0:21171:0:(genops.c:885:class_export_put()) final put ffff9611c882c000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788612803.587415:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c7a6f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788612803.587441:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c882c000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788612803.589786:0:21171:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788612803.589794:0:21171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788612803.589798:0:21171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788612803.589805:0:21171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788612803.589975:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612803.589992:0:21171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788612803.589998:0:21171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788612803.590003:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612803.590007:0:21171:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788612803.590013:0:21171:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9611c7520800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788612803.590019:0:21171:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9612fcfc4d40) has exports, disconnecting them 00000020:00080000:0.0:1788612803.590023:0:21171:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9611c7520800), last request at 1788612735 00000020:00000080:0.0:1788612803.590027:0:21171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9370 00000020:00080000:0.0:1788612803.590041:0:21171:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9611c7520800): rc 0 00000020:00000080:0.0:1788612803.590046:0:21171:0:(genops.c:885:class_export_put()) final put ffff9611c7520800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788612803.590387:0:15779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c882e800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788612803.590394:0:15779:0:(genops.c:885:class_export_put()) final put ffff9611c8828000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788612803.590397:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c8828000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788612803.590402:0:15779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788612803.590467:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c7520800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788612803.593556:0:21171:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788612803.593564:0:21171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788612803.593568:0:21171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788612803.593574:0:21171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788612803.593602:0:15779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c7524800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788612803.593756:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788612803.593763:0:21171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788612803.593768:0:21171:0:(genops.c:885:class_export_put()) final put ffff9611c7521000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788612803.593771:0:21171:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c7521000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788612803.593776:0:21171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788612803.593844:0:21171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9612fe89a000 1 00000020:00000080:1.0:1788612803.593849:0:21171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc930e 00000020:00000080:1.0:1788612803.593854:0:21171:0:(genops.c:885:class_export_put()) final put ffff9612c7193800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788612803.593861:0:21171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788612803.593868:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c7193800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788612803.593874:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788612803.593879:0:21171:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788612803.593882:0:21171:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9611c64b8000) has no exports 00000020:00000080:2.0:1788612803.710616:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788612803.710631:0:21171:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788612803.710637:0:21171:0:(genops.c:885:class_export_put()) final put ffff9611c78b4800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788612803.710641:0:21171:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c78b4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788612803.710653:0:21171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788612803.710774:0:21171:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9611c78b3000 00000020:02000400:2.0:1788612803.710817:0:21171:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788612804.528613:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612805.558529:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612806.581668:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788612807.522392:0:21372:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788612807.546760:0:21372:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788612807.546991:0:21372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc94a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc94ab expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612807.547005:0:21372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc94a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc94ab expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612807.547030:0:21372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc94a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc94ab expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612807.547036:0:21372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc94a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc94ab expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612807.547057:0:21372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788612807.547063:0:21372:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788612807.547087:0:21372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788612807.547098:0:21372:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9612febbf800 x1875495932362624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788612822 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612807.547172:0:21372:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788612807.547179:0:21372:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788612807.547185:0:21372:0:(import.c:65:import_set_state_nolock()) ffff9612c6ac1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788612807.547189:0:21372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788612807.547193:0:21372:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9612febbf800 x1875495932362624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788612822 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788612807.547262:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612807.547269:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc94a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc94ab expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612807.547276:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2200 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:2.0:1788612807.547280:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc94a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc94ab expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612807.547288:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc94a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc94ab expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612807.547294:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc94a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc94ab expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612807.547300:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788612807.547302:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788612807.547304:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788612807.547323:0:17187:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96130066d800 00010000:00010000:2.0:1788612807.547327:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc94a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc94ab expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612807.547334:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc94a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc94ab expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612807.547345:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612807.547346:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612807.547348:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612807.549302:0:21372:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788612807.549399:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932362624:0@lo:38:kworker.0 00000100:00100000:0.0:1788612807.549462:0:21372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788612807.550903:0:21372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788612807.550916:0:21372:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9612febbc000 x1875495932362752/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788612817 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612807.550989:0:21372:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788612807.550995:0:21372:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788612807.551001:0:21372:0:(import.c:65:import_set_state_nolock()) ffff9611c663f000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788612807.551005:0:21372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788612807.551024:0:21372:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9612febbc000 x1875495932362752/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788612817 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612807.551077:0:21372:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788612807.551097:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875495932362752:0@lo:38:kworker.0 00000100:00100000:0.0:1788612807.551138:0:21372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788612807.556416:0:21372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc947a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9481 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612807.556435:0:21372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc947a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9481 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612807.556443:0:21372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc947a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc9481 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612807.556449:0:21372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc947a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc9481 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612807.556553:0:21372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612807.556563:0:21372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c799b000/0x1f8616bf0bc9672 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9679 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612807.556570:0:21372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c799b000/0x1f8616bf0bc9672 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9679 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612807.556576:0:21372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c799b000/0x1f8616bf0bc9672 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc9679 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612807.556600:0:21372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9611c799b000/0x1f8616bf0bc9672 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1f8616bf0bc9679 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612807.559023:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612807.559036:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc947a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc9481 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612807.559068:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2800 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612807.559072:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc947a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc9481 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612807.559082:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc947a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc9481 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612807.559090:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc947a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc9481 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612807.559095:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788612807.559098:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788612807.559112:0:17186:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96130066d800 00010000:00010000:3.0:1788612807.559115:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc947a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc9481 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612807.559122:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc947a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc9481 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612807.559140:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612807.559144:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c799b000/0x1f8616bf0bc9672 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc9679 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612807.559149:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c799b000 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612807.559152:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c799b000/0x1f8616bf0bc9672 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1f8616bf0bc9679 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612807.559169:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c799b000/0x1f8616bf0bc9672 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc9679 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612807.559186:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c799b000/0x1f8616bf0bc9672 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc9679 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612807.559191:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788612807.559193:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788612807.559198:0:17186:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96130066d800 00010000:00010000:3.0:1788612807.559200:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c799b000/0x1f8616bf0bc9672 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc9679 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612807.559207:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612807.559209:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612807.559211:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612807.559420:0:21372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612807.559427:0:21372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c799b000/0x1f8616bf0bc9672 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc9679 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612807.559441:0:21372:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788612807.559445:0:21372:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1788612807.559447:0:21372:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788612807.559514:0:21372:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788612807.559518:0:21372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788612807.559592:0:21372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788612807.559599:0:21372:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788612807.559604:0:21372:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9611c64bcd40) has no exports 00000020:00080000:3.0:1788612807.559628:0:21372:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9611c64bcd40) has no exports 00010000:00010000:0.0:1788612807.561595:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788612807.562992:0:21372:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9611c7b41d20 - data ffff9611c5c45510/ffff9611c5b08800 00000020:01000000:3.0:1788612807.563146:0:21372:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9611c64cb540 - data ffff9612ea44fca8/ffff9611c5b09000 00100000:10000000:3.0:1788612807.573049:0:21372:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788612807.583569:0:21372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc948f 00000020:00000080:2.0:1788612807.583581:0:21372:0:(genops.c:885:class_export_put()) final put ffff9611c591b800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788612807.583596:0:21372:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9611c7525800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788612807.583599:0:21372:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9611c7525800 2 00000020:01000004:2.0:1788612807.583603:0:21372:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9611c7525800 from lustre-OST0001 00000020:00000080:2.0:1788612807.583631:0:21372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788612807.583640:0:21372:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788612807.583644:0:21372:0:(genops.c:885:class_export_put()) final put ffff9611c591a800/lustre-OST0001_UUID 00000020:00000080:2.0:1788612807.583646:0:21372:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c591a800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788612807.583653:0:21372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1788612807.583877:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c591b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1788612807.583963:0:21372:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d240c1fb-ce1c-496f-9994-daecd37f5c24->MGS 00010000:00010000:2.0:1788612807.583978:0:21372:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612f7b37e00/0x1f8616bf0bc91da lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc91e1 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612807.583991:0:21372:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b37e00/0x1f8616bf0bc91da lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc91e1 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612807.583997:0:21372:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788612807.584009:0:21372:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788612807.584012:0:21372:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788612807.584027:0:21372:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96130066d800 00010000:00010000:2.0:1788612807.584031:0:21372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612f7b37e00/0x1f8616bf0bc91da lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc91e1 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612807.584046:0:21372:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c7240a00/0x1f8616bf0bc90c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1f8616bf0bc90d0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612807.584053:0:21372:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c7240a00/0x1f8616bf0bc90c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1f8616bf0bc90d0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612807.584058:0:21372:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788612807.584061:0:21372:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788612807.584062:0:21372:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788612807.584071:0:21372:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96130066d800 00010000:00010000:2.0:1788612807.584074:0:21372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c7240a00/0x1f8616bf0bc90c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1f8616bf0bc90d0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788612807.584091:0:21372:0:(import.c:65:import_set_state_nolock()) ffff96130066d800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788612807.584094:0:21372:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788612807.584097:0:21372:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788612807.584098:0:21372:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788612807.584102:0:21372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788612807.584112:0:21372:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9612fccc5180 x1875495932361728/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788612807 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788612807.584131:0:21372:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788612807.584134:0:21372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788612807.584196:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d240c1fb-ce1c-496f-9994-daecd37f5c24:3647:1875495932361728:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:2.0:1788612807.584256:0:21372:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788612807.584264:0:21372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc90b4 00000020:00000080:2.0:1788612807.584268:0:21372:0:(genops.c:885:class_export_put()) final put ffff9612c7195000/d240c1fb-ce1c-496f-9994-daecd37f5c24 00000020:01000000:2.0:1788612807.584282:0:21372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.130@tcp (flags='') 00000020:00000080:2.0:1788612807.584291:0:21372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788612807.584296:0:21372:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.130@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788612807.584300:0:21372:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9611c5a23380) has no exports 00000020:00000080:0.0:1788612807.584352:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c7195000/d240c1fb-ce1c-496f-9994-daecd37f5c24 for MGC192.168.203.130@tcp 10000000:01000000:1.0:1788612807.584392:0:17195:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788612807.584468:0:21372:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.130@tcp: client import never connected 00000100:00080000:2.0:1788612807.584471:0:21372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788612807.584548:0:21372:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788612807.584551:0:21372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788612807.584553:0:21372:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788612807.584596:0:21372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788612807.584601:0:21372:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.130@tcp (uuid d240c1fb-ce1c-496f-9994-daecd37f5c24) 00000020:01000000:2.0:1788612807.584606:0:21372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788612807.584609:0:21372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788612807.584612:0:21372:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788612807.584617:0:21372:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9611c663c000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788612807.584622:0:21372:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9612fb858000) has exports, disconnecting them 00000020:00080000:2.0:1788612807.584627:0:21372:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9611c663c000), last request at 1788612751 00000020:00000080:2.0:1788612807.584630:0:21372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc94b9 00000020:00080000:2.0:1788612807.584641:0:21372:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9611c663c000): rc 0 00000020:00000080:2.0:1788612807.584645:0:21372:0:(genops.c:885:class_export_put()) final put ffff9611c663c000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788612807.584878:0:15779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96130066d800 for MGC192.168.203.130@tcp 00000020:00000080:0.0:1788612807.584885:0:15779:0:(genops.c:885:class_export_put()) final put ffff961300669000/d240c1fb-ce1c-496f-9994-daecd37f5c24 00000020:00000080:0.0:1788612807.584887:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff961300669000/d240c1fb-ce1c-496f-9994-daecd37f5c24 for MGC192.168.203.130@tcp 00000020:01000000:0.0:1788612807.584891:0:15779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.130@tcp (d240c1fb-ce1c-496f-9994-daecd37f5c24) 00000020:00000080:0.0:1788612807.585130:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c663c000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788612807.633693:0:21372:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788612807.633702:0:21372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788612807.633707:0:21372:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788612807.633715:0:21372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788612807.633929:0:21372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788612807.633938:0:21372:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788612807.633945:0:21372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788612807.633951:0:21372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788612807.633966:0:21372:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788612807.633974:0:21372:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9611c663d800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788612807.633980:0:21372:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9612fb8599c0) has exports, disconnecting them 00000020:00080000:0.0:1788612807.633985:0:21372:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9611c663d800), last request at 1788612751 00000020:00000080:0.0:1788612807.633989:0:21372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc94ce 00000020:00080000:0.0:1788612807.634005:0:21372:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9611c663d800): rc 0 00000020:00000080:0.0:1788612807.634010:0:21372:0:(genops.c:885:class_export_put()) final put ffff9611c663d800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788612807.634997:0:15779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9612c6ac1800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788612807.635008:0:15779:0:(genops.c:885:class_export_put()) final put ffff9612c6ac5000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788612807.635012:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c6ac5000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788612807.635023:0:15779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788612807.635087:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c663d800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788612807.666642:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:01000000:1.0:1788612807.689628:0:21372:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788612807.689637:0:21372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788612807.689642:0:21372:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788612807.689650:0:21372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788612807.689751:0:15779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9611c663f000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788612807.692880:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788612807.693878:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1788612807.694111:0:17181:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9611c139b600:17181] 0 exiting: rc = 1 00000100:00100000:1.0:1788612807.696673:0:17182:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9612c93e5000:17182] 1 exiting: rc = 0 00000100:00100000:2.0:1788612807.696870:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788612807.697169:0:17183:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff961300751800:17183] 0 exiting: rc = 1 00000100:00100000:0.0:1788612807.697656:0:17185:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9611c64a1800:17185] 2 exiting: rc = 0 00000100:00100000:0.0:1788612807.697719:0:17184:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9611c64a1e00:17184] 1 exiting: rc = 0 00000100:00100000:0.0:1788612807.698026:0:20223:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9612e807ec00:20223] 3 exiting: rc = 0 00000100:00100000:2.0:1788612807.698169:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698178:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698183:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698191:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698197:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698204:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698210:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698215:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698234:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698239:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698245:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698250:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698256:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698261:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698267:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698272:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698277:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698282:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698288:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698293:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698298:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698302:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698307:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698312:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698318:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698323:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698328:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698333:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698339:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698344:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698349:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698354:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698359:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698364:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698368:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698372:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698377:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698382:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698387:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698392:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698398:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698403:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698408:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698422:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698428:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698433:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698437:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698442:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698447:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698452:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698456:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698461:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698466:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698471:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698500:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698505:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698510:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698514:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698519:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698524:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698529:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698534:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698539:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.698544:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788612807.701774:0:21372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788612807.701788:0:21372:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788612807.701794:0:21372:0:(genops.c:885:class_export_put()) final put ffff9611c663a000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788612807.701798:0:21372:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c663a000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788612807.701804:0:21372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788612807.701869:0:21372:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9611c7525800 1 00000020:00000080:2.0:1788612807.701875:0:21372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1f8616bf0bc9473 00000020:00000080:2.0:1788612807.701882:0:21372:0:(genops.c:885:class_export_put()) final put ffff9611c7a6b800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788612807.701904:0:21372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788612807.701909:0:21372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788612807.701914:0:21372:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788612807.701918:0:21372:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9612fcfc19c0) has no exports 00000020:00000080:1.0:1788612807.704499:0:15779:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c7a6b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788612807.740574:0:21372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788612807.740601:0:21372:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788612807.740608:0:21372:0:(genops.c:885:class_export_put()) final put ffff9611c7527000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788612807.740613:0:21372:0:(genops.c:844:class_export_destroy()) destroying export ffff9611c7527000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788612807.740628:0:21372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788612807.741745:0:21372:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9611c7522800 00000020:01000000:2.0:1788612807.744307:0:21372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788612807.744346:0:21372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788612807.744355:0:21372:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788612807.744360:0:21372:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9611c64bb380) has no exports 00000020:00000080:2.0:1788612807.744395:0:21372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788612807.744404:0:21372:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788612807.744409:0:21372:0:(genops.c:885:class_export_put()) final put ffff9612c28ac000/OSS_uuid 00000020:00000080:2.0:1788612807.744413:0:21372:0:(genops.c:844:class_export_destroy()) destroying export ffff9612c28ac000/OSS_uuid for OSS 00000020:01000000:2.0:1788612807.744420:0:21372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788612807.744741:0:17194:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788612807.747209:0:18704:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9612e9180c00:18704] 0 exiting: rc = 1 00000100:00100000:3.0:1788612807.747334:0:19152:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9611c6af2a00:19152] 3 exiting: rc = 0 00000100:00100000:2.0:1788612807.749089:0:18707:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9612e9181c00:18707] 2 exiting: rc = 0 00000100:00100000:0.0:1788612807.749767:0:18706:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9612fb839c00:18706] 1 exiting: rc = 0 00000100:00100000:3.0:1788612807.749913:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.749921:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.749926:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.749930:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.749935:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.749940:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.749945:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.749950:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.749984:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.749990:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.749995:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750001:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750006:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750010:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750015:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750020:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750025:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750030:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750035:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750040:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750044:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750049:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750053:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750058:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750063:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750068:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750072:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750077:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750082:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750086:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750091:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750096:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750100:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750104:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750110:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750114:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750119:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750124:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750129:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750133:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750138:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750144:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750149:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750159:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750164:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750169:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750174:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750179:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750184:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750189:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750194:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750199:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750204:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750208:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750213:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750217:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750222:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750232:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750237:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750242:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750247:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750252:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750257:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.750262:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612807.751060:0:18709:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9612c6ab0e00:18709] 1 exiting: rc = 0 00000100:00100000:0.0:1788612807.751161:0:20368:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9612c7b9ba00:20368] 2 exiting: rc = 0 00000100:00100000:2.0:1788612807.753122:0:18708:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9611c6a01a00:18708] 0 exiting: rc = 1 00000100:00100000:3.0:1788612807.753906:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.753917:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.753923:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.753929:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.753934:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.753940:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.753946:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.753951:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.753967:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.753972:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.753977:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.753983:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.753988:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.753993:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754015:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754020:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754025:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754030:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754035:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754040:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754045:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754050:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754055:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754059:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754092:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754099:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754104:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754109:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754115:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754120:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754125:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754130:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754135:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754140:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754145:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754150:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754156:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754161:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754167:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754172:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754178:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754183:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754188:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754193:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754199:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754204:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754209:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754214:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754220:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754233:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754238:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754243:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754248:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754254:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754259:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754264:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754269:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754277:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754283:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754287:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754292:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754297:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754302:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.754314:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.756552:0:18712:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9612e9180400:18712] 2 exiting: rc = 0 00000100:00100000:2.0:1788612807.757775:0:18711:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9612e9181e00:18711] 1 exiting: rc = 0 00000100:00100000:0.0:1788612807.758246:0:18710:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9612e9181600:18710] 0 exiting: rc = 1 00000100:00100000:3.0:1788612807.758542:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758551:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758556:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758561:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758584:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758591:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758596:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758602:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758608:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758613:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758618:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758625:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758631:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758637:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758643:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758649:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758654:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758660:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758665:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758684:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758690:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758696:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758702:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758708:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758714:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758719:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758724:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758730:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758751:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758759:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758776:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758782:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758787:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758792:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758798:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758803:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758808:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758814:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758820:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758825:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758830:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758835:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758840:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758844:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758849:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758854:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758859:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758864:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758868:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758873:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758878:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758884:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758903:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758910:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758921:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758927:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758932:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758937:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758942:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758947:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758963:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758977:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758984:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788612807.758997:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612807.771583:0:18713:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9612e9186a00:18713] 0 exiting: rc = 1 00000100:00100000:3.0:1788612807.772370:0:18714:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9612e9186800:18714] 1 exiting: rc = 0 00000100:00100000:2.0:1788612807.772501:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772509:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772514:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772520:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772525:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772530:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772535:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772540:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772545:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772549:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772554:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772559:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772564:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772569:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772574:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772578:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772599:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772604:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772609:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772614:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772619:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772624:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772629:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772634:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772639:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772644:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772649:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772653:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772658:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772663:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772668:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772673:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772679:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772684:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772689:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772695:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772701:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772706:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772711:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772717:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772722:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772728:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772734:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772739:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772745:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772750:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772755:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772760:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772765:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772771:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772776:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772790:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772797:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772804:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772810:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772816:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772821:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772827:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772832:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772838:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772844:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772849:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772856:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.772862:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788612807.773676:0:18715:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9611c793ea00:18715] 0 exiting: rc = 1 00000100:00100000:3.0:1788612807.773805:0:18716:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9612c29d7400:18716] 1 exiting: rc = 0 00000100:00100000:2.0:1788612807.774040:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774054:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774062:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774068:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774074:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774081:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774086:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774093:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774098:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774106:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774129:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774137:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774143:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774150:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774156:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774162:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774168:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774176:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774181:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774187:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774192:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774197:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774228:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774234:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774240:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774246:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774252:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774257:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774264:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774270:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774275:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774281:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774287:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774293:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774312:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774321:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774327:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774333:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774339:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774344:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774458:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774468:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774566:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774576:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774582:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774589:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774612:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774620:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774626:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774632:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774638:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774644:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774650:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774658:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774664:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774671:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774677:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774692:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774710:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774717:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774723:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774729:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774737:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788612807.774751:0:21372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788612807.794839:0:21372:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788612827.308847:0:22136:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788612837.627901:0:22735:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788612837.627908:0:22735:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788612837.627912:0:22735:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788612837.628019:0:22735:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9612e9172000 00000020:01000004:1.0:1788612837.628034:0:22735:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788612837.628041:0:22735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788612837.628055:0:22735:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9612d1e60000) 00000020:00000080:1.0:1788612837.628069:0:22735:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788612837.694880:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788612837.695159:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788612837.698241:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788612837.699969:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788612837.700201:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788612837.700516:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788612837.700795:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788612837.700985:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788612837.701180:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788612837.701436:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788612837.701740:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788612837.701965:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788612837.702181:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788612837.702441:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788612837.702655:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788612837.703033:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788612837.703299:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788612837.703651:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788612837.703840:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788612837.704024:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788612837.704233:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788612837.704510:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788612837.704765:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788612837.704956:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788612837.705179:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788612837.705467:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788612837.705954:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788612837.706151:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788612837.706345:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788612837.706660:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788612837.706864:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788612837.707058:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788612837.707244:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788612837.707522:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788612837.707813:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788612837.708190:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788612837.708365:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788612837.708870:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788612837.709215:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788612837.709469:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788612837.709802:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788612837.709990:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788612837.710541:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788612837.711168:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788612837.711452:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788612837.711780:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788612837.712143:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788612837.713635:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788612837.713987:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788612837.714332:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788612837.714830:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788612837.715242:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788612837.715536:0:22735:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:2.0:1788612837.716303:0:22735:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788612837.716773:0:22735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788612837.716781:0:22735:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788612837.716794:0:22735:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc9927 00000020:01000004:2.0:1788612837.716802:0:22735:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788612837.716807:0:22735:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788612837.716812:0:22735:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9612e9172000 from MGS 00000020:01000004:2.0:1788612837.716816:0:22735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788612837.716827:0:22735:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9612fcfc19c0) 00000020:00000080:2.0:1788612837.716837:0:22735:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788612837.716897:0:22735:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9612e9172000 from MGS, refs=2 00080000:01000000:2.0:1788612837.716903:0:22735:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788612837.716907:0:22735:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc9935 00000100:00100000:2.0:1788612837.717000:0:22735:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788612837.717125:0:22735:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788612837.717132:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788612837.717710:0:22735:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788612837.717717:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788612837.718333:0:22735:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612837.718691:0:22735:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788612837.718696:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788612837.719465:0:22735:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788612837.719530:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788612837.719922:0:22735:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788612837.719929:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788612837.720802:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612837.720805:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612837.720807:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612837.721070:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612837.721072:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612837.721074:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612837.721550:0:22735:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:1.0:1788612837.726188:0:22735:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:2.0:1788612837.727088:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788612837.727660:0:22747:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788612837.727745:0:22735:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788612837.727798:0:22735:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788612837.728348:0:22735:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788612837.729050:0:22735:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788612837.729201:0:22735:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788612837.729208:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788612837.733238:0:22735:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788612837.733253:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788612837.738402:0:22735:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788612837.738419:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788612837.740954:0:22735:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788612837.740979:0:22735:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.130@tcp' 00000020:01000004:1.0:1788612837.740981:0:22735:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788612837.741010:0:22735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.130@tcp (typ=mgc) 00000020:00000080:1.0:1788612837.741022:0:22735:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.130@tcp (ffff9612d1e63380) 00000020:00000080:1.0:1788612837.741037:0:22735:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788612837.741135:0:22735:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9612e9172800@MGC192.168.203.130@tcp: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1788612837.741349:0:22735:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.130@tcp-0 is initialized 00000040:01000000:1.0:1788612837.741356:0:22735:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788612837.742794:0:22753:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788612837.742876:0:22735:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.130@tcp (uuid a6b44f55-8b88-4406-a946-d178714afb91) 00000020:00000080:1.0:1788612837.742898:0:22735:0:(genops.c:1385:class_connect()) connect: client a6b44f55-8b88-4406-a946-d178714afb91, cookie 0x1f8616bf0bc9943 00000100:00080000:1.0:1788612837.742909:0:22735:0:(import.c:545:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788612837.742915:0:22735:0:(import.c:665:import_select_connection()) MGC192.168.203.130@tcp: import ffff9612e9172800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612837.742948:0:22735:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc76f800 x1875495932362880/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788612837.742977:0:22735:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a6b44f55-8b88-4406-a946-d178714afb91->MGS 00000020:01000004:1.0:1788612837.742993:0:22735:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788612837.742998:0:22735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788612837.743011:0:22735:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9612d1e64d40) 00000020:00000080:1.0:1788612837.743021:0:22735:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788612837.743333:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a6b44f55-8b88-4406-a946-d178714afb91:3647:1875495932362880:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788612837.743414:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788612837.743529:0:22752:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1788612837.743889:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932362880 00000100:00100000:3.0:1788612837.743897:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932362880 00000100:00100000:3.0:1788612837.743933:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612837.743941:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1875495932362880:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788612837.743968:0:22748:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a6b44f55-8b88-4406-a946-d178714afb91@0@lo t0 exp 0000000000000000 cur 652 last 0 00000020:00000080:3.0:1788612837.743992:0:22748:0:(genops.c:1385:class_connect()) connect: client a6b44f55-8b88-4406-a946-d178714afb91, cookie 0x1f8616bf0bc9951 00000100:00080000:3.0:1788612837.744115:0:22748:0:(import.c:65:import_set_state_nolock()) ffff9611c8f8c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612837.744171:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+5:3647:x1875495932362880:12345-0@lo:250:mount.lustre.0 Request processed in 229us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612837.744178:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612837.744217:0:3647:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788612837.744224:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.130@tcp: connect to target with instance 0 00000100:00080000:3.0:1788612837.744231:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788612837.744235:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788612837.744246:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612e9172800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788612837.744248:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788612837.744254:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788612837.744259:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a6b44f55-8b88-4406-a946-d178714afb91:3647:1875495932362880:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788612837.755837:0:22735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788612837.756043:0:22735:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788612837.756051:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788612837.756709:0:22735:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788612837.756716:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788612837.757716:0:22735:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788612837.757724:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788612837.759456:0:22735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788612837.760024:0:22735:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788612837.760030:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788612837.760714:0:22735:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788612837.760727:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788612837.806201:0:22735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788612837.806646:0:22735:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788612837.806653:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788612837.810661:0:22735:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788612837.810676:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788612837.812018:0:22735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612837.812205:0:22735:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788612837.812211:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788612837.813278:0:22735:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788612837.813287:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788612837.814397:0:22735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612837.814662:0:22735:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788612837.814668:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788612837.815264:0:22735:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788612837.815271:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788612837.816053:0:22735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612837.816200:0:22735:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788612837.816205:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788612837.816982:0:22735:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788612837.816990:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788612837.836624:0:22735:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788612837.836840:0:22735:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788612837.836847:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788612837.844600:0:22735:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788612837.844619:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788612837.846427:0:22735:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788612837.846438:0:22735:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788612837.850073:0:22735:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788612837.850103:0:22735:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788612837.850109:0:22735:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788612837.850228:0:22735:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788612837.850267:0:22735:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788612837.850272:0:22735:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788612837.850273:0:22735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788612837.850275:0:22735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612837.850276:0:22735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612837.850277:0:22735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612837.850279:0:22735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612837.850280:0:22735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788612837.850281:0:22735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788612837.850283:0:22735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612837.850284:0:22735:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788612837.850287:0:22735:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788612837.850289:0:22735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788612837.850291:0:22735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788612837.850292:0:22735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612837.850293:0:22735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612837.850294:0:22735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612837.850295:0:22735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612837.850296:0:22735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788612837.850297:0:22735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788612837.850298:0:22735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612837.850304:0:22735:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788612837.850328:0:22735:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788612837.850348:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc717480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932363008:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788612837.850418:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612837.850465:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788612837.850936:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932363008 00000100:00100000:1.0:1788612837.850944:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932363008 00000100:00100000:1.0:1788612837.850994:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612837.851004:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+5:22735:x1875495932363008:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788612837.851049:0:22751:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788612837.851052:0:22751:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788612837.851055:0:22751:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788612837.853301:0:22772:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788612837.854054:0:22751:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1788612837.859608:0:22773:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788612837.859617:0:22773:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788612837.859620:0:22773:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788612837.859622:0:22773:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788612837.860138:0:22773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788612837.860353:0:22751:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788612837.860365:0:22751:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788612837.864782:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+5:22735:x1875495932363008:12345-0@lo:253:mount.lustre.0 Request processed in 13773us (14356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612837.864795:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612837.864931:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc717480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932363008:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788612837.864948:0:22735:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788612837.864951:0:22735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788612837.864953:0:22735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788612837.864954:0:22735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612837.864955:0:22735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612837.864956:0:22735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612837.864958:0:22735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612837.864960:0:22735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788612837.864961:0:22735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788612837.864963:0:22735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612837.864964:0:22735:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788612837.864989:0:22735:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9612e9172000 from lustre-MDT0000 10000000:01000000:3.0:1788612837.865026:0:22735:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788612837.865029:0:22735:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788612837.865033:0:22735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9612d1e63380 10000000:01000000:3.0:1788612837.865038:0:22735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788612837.865045:0:22735:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9612d1e63380 from 1 10000000:01000000:3.0:1788612837.865048:0:22735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788612837.865087:0:22735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612e81dae00/0x1f8616bf0bc9958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612837.865098:0:22735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612e81dae00/0x1f8616bf0bc9958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612837.865107:0:22735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612e81dae00/0x1f8616bf0bc9958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612837.865125:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc717480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932363136:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788612837.865171:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612837.865210:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9480 going to sleep for 11 seconds 00000100:00100000:2.0:1788612837.865338:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932363136 00000100:00100000:2.0:1788612837.865345:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932363136 00000100:00100000:2.0:1788612837.865383:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788612837.865393:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+5:22735:x1875495932363136:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612837.865410:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612837.865424:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612f7b36a00/0x1f8616bf0bc995f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9958 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612837.865445:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612f7b36a00/0x1f8616bf0bc995f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9958 expref: 6 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612837.865457:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612f7b36a00/0x1f8616bf0bc995f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9958 expref: 6 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612837.865466:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36a00, rc 0) 00000100:00100000:2.0:1788612837.865527:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+6:22735:x1875495932363136:12345-0@lo:101:mount.lustre.0 Request processed in 136us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612837.865533:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612837.865713:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc717480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932363136:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612837.865727:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612e81dae00/0x1f8616bf0bc9958 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc995f expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612837.865735:0:22735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612e81dae00/0x1f8616bf0bc9958 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc995f expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612837.865805:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932363264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612837.865833:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612837.865865:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0dc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612837.865915:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932363264 00000100:00100000:2.0:1788612837.865930:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932363264 00000100:00100000:2.0:1788612837.865964:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788612837.865971:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+6:22735:x1875495932363264:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612837.866048:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+6:22735:x1875495932363264:12345-0@lo:501:mount.lustre.0 Request processed in 77us (214us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788612837.866055:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612837.866221:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932363264:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788612837.866250:0:22735:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788612837.866277:0:22735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612e81dae00/0x1f8616bf0bc9958 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc995f expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612837.866285:0:22735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612e81dae00/0x1f8616bf0bc9958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc995f expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612837.866293:0:22735:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9612e9172000 10000000:01000000:1.0:1788612837.866297:0:22735:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788612837.866301:0:22735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9612e9172000 10000000:01000000:1.0:1788612837.866303:0:22735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788612837.866305:0:22735:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9612e9172000 from 1 10000000:01000000:1.0:1788612837.866308:0:22735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788612837.866326:0:22735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1000/0x1f8616bf0bc9966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612837.866334:0:22735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c13d1000/0x1f8616bf0bc9966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612837.866345:0:22735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c13d1000/0x1f8616bf0bc9966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612837.866357:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932363392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788612837.866384:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612837.866401:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0dc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612837.866447:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932363392 00000100:00100000:3.0:1788612837.866451:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932363392 00000100:00100000:3.0:1788612837.866502:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612837.866508:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+6:22735:x1875495932363392:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612837.866515:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612837.866525:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612e81db200/0x1f8616bf0bc996d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9966 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612837.866538:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612e81db200/0x1f8616bf0bc996d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9966 expref: 7 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612837.866547:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612e81db200/0x1f8616bf0bc996d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9966 expref: 7 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612837.866562:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612e81db200, rc 0) 00000100:00100000:3.0:1788612837.866592:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+7:22735:x1875495932363392:12345-0@lo:101:mount.lustre.0 Request processed in 85us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612837.866598:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612837.866825:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932363392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612837.866839:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c13d1000/0x1f8616bf0bc9966 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc996d expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612837.866847:0:22735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c13d1000/0x1f8616bf0bc9966 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc996d expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612837.866867:0:22735:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788612837.866881:0:22735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1000/0x1f8616bf0bc9966 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc996d expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612837.866888:0:22735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c13d1000/0x1f8616bf0bc9966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc996d expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612837.866894:0:22735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788612837.866897:0:22735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788612837.866901:0:22735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9612e9172000 10000000:01000000:1.0:1788612837.866904:0:22735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788612837.866906:0:22735:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788612837.866908:0:22735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788612837.867023:0:22735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d0400/0x1f8616bf0bc9974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612837.867032:0:22735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c13d0400/0x1f8616bf0bc9974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612837.867039:0:22735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c13d0400/0x1f8616bf0bc9974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612837.867053:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932363520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788612837.867079:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612837.867095:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0dc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612837.867149:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932363520 00000100:00100000:3.0:1788612837.867154:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932363520 00000100:00100000:3.0:1788612837.867183:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612837.867190:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+7:22735:x1875495932363520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612837.867198:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612837.867206:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612e81da800/0x1f8616bf0bc997b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9974 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612837.867220:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612e81da800/0x1f8616bf0bc997b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9974 expref: 8 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612837.867234:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612e81da800/0x1f8616bf0bc997b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9974 expref: 8 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612837.867241:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612e81da800, rc 0) 00000100:00100000:3.0:1788612837.867276:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+8:22735:x1875495932363520:12345-0@lo:101:mount.lustre.0 Request processed in 86us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612837.867282:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788612837.867380:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932363520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612837.867391:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c13d0400/0x1f8616bf0bc9974 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc997b expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612837.867406:0:22735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c13d0400/0x1f8616bf0bc9974 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc997b expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612837.867455:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932363648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612837.867659:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612837.867715:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0dc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612837.874007:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932363648 00000100:00100000:2.0:1788612837.874022:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932363648 00000100:00100000:3.0:1788612837.876279:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612837.876294:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+8:22735:x1875495932363648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612837.876592:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+9:22735:x1875495932363648:12345-0@lo:501:mount.lustre.0 Request processed in 300us (8932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612837.876601:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788612837.876901:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932363648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612837.877030:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932363776:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612837.877085:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612837.877153:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0dc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612837.878894:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932363776 00000100:00100000:2.0:1788612837.878907:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932363776 00000100:00100000:2.0:1788612837.883148:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788612837.883163:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+9:22735:x1875495932363776:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788612837.884462:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+9:22735:x1875495932363776:12345-0@lo:503:mount.lustre.0 Request processed in 1294us (7370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612837.884601:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932363776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788612837.884970:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788612837.885135:0:22774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc717b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6b44f55-8b88-4406-a946-d178714afb91:22774:1875495932363904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612837.885185:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612837.885222:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6cac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612837.885264:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932363904 00000100:00100000:2.0:1788612837.885277:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932363904 00000100:00100000:2.0:1788612837.885318:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612837.885327:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+9:22774:x1875495932363904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612837.885903:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+9:22774:x1875495932363904:12345-0@lo:502:llog_process_th.0 Request processed in 576us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612837.885989:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788612837.886123:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc717b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6b44f55-8b88-4406-a946-d178714afb91:22774:1875495932363904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788612837.886151:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612837.886164:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612837.886166:0:22774:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788612837.886171:0:22774:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788612837.886174:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788612837.886188:0:22774:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9612fb85b380) 00000020:00000080:0.0:1788612837.886203:0:22774:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788612837.886208:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788612837.886396:0:22774:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788612837.886406:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc9989 00000020:00000080:0.0:1788612837.886620:0:22774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788612837.886625:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612837.886629:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612837.886630:0:22774:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788612837.886632:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788612837.886636:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612837.886637:0:22774:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788612837.886640:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788612837.886648:0:22774:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9612fb8599c0) 00000020:00000080:0.0:1788612837.886657:0:22774:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788612837.886660:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788612837.886662:0:22774:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788612837.886664:0:22774:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788612837.886670:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788612837.886708:0:22774:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9612e9172000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788612837.886719:0:22774:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9612fb858000) 00000020:00000080:0.0:1788612837.886728:0:22774:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788612837.886790:0:22774:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788612837.886795:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc999e 00000020:00000080:0.0:1788612837.886880:0:22774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788612837.886884:0:22774:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788612837.886888:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1f8616bf0bc99a5 00080000:01000000:0.0:1788612837.886892:0:22774:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788612837.886894:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc99ac 00010000:00010000:2.0:1788612837.980248:0:22774:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788612837.981913:0:22774:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934627 00000001:00080000:2.0:1788612837.982245:0:22774:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788612837.986502:0:22774:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9612fcfc4d40) 00000020:00000080:2.0:1788612837.986522:0:22774:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788612837.987422:0:22774:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788612837.987435:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc99ba 00000020:00000080:3.0:1788612837.989269:0:22774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788612837.994220:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1f8616bf0bc99c1 00000020:00000080:3.0:1788612837.994780:0:22774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788612837.994791:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612837.994798:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612837.994800:0:22774:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788612837.994802:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788612837.994805:0:22774:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788612837.994807:0:22774:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788612837.994808:0:22774:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788612837.994810:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788612837.994812:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612837.994819:0:22774:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788612837.994822:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612837.994828:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612837.994830:0:22774:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788612837.994834:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788612837.994870:0:22774:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788612837.994883:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612837.994885:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612837.994887:0:22774:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788612837.994889:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612837.994892:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612837.994893:0:22774:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788612837.994896:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788612837.994901:0:22774:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:3.0:1788612837.994925:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788612837.994939:0:22774:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9611c64bb380) 00000020:00000080:3.0:1788612837.994953:0:22774:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788612837.994957:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788612837.995003:0:22774:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788612837.995008:0:22774:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788612837.995013:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc99cf 00010000:00080000:3.0:1788612837.995041:0:22774:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9612fccfc000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1788612838.002543:0:22774:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788612838.005883:0:22774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788612838.005897:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788612838.005949:0:22774:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788612838.005972:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc99d6 00000100:00080000:3.0:1788612838.005981:0:22774:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788612838.005987:0:22774:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9612fccfc000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612838.006020:0:22774:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc717800 x1875495932364032/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788612838.006098:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932364032:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788612838.006175:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788612838.007067:0:22774:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788612838.007144:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612838.007150:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612838.007152:0:22774:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788612838.007154:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788612838.007157:0:22774:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788612838.007159:0:22774:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788612838.007160:0:22774:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788612838.007162:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788612838.007164:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612838.007165:0:22774:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788612838.007167:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788612838.007171:0:22774:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788612838.007175:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612838.007176:0:22774:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788612838.007179:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788612838.007183:0:22774:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:3.0:1788612838.007202:0:22774:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788612838.007205:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788612838.007220:0:22774:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9611c64bcd40) 00000020:00000080:3.0:1788612838.007235:0:22774:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788612838.007240:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788612838.007325:0:22774:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788612838.007332:0:22774:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788612838.007341:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc99e4 00010000:00080000:3.0:1788612838.007371:0:22774:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9611c80c2800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.130@tcp at head 00000100:00100000:0.0:1788612838.007683:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932364032 00000100:00100000:0.0:1788612838.007692:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932364032 00000100:00100000:0.0:1788612838.007722:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612838.007729:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875495932364032:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1788612838.007752:0:22761:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:3.0:1788612838.010932:0:22774:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788612838.019812:0:22774:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788612838.020055:0:22774:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788612838.021895:0:22774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788612838.022084:0:22774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:0.0:1788612838.026348:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875495932364032:12345-0@lo:38:llog_process_th.0 Request processed in 18611us (20165us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788612838.026375:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788612838.026546:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612fccfc000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788612838.026562:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788612838.026566:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932364032:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788612838.029954:0:22774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1788612838.036209:0:22780:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788612838.036218:0:22780:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788612838.037120:0:22774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788612838.037132:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788612838.037167:0:22774:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788612838.037187:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc99eb 00000100:00080000:2.0:1788612838.037198:0:22774:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788612838.037205:0:22774:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9611c80c2800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788612838.037241:0:22774:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fccc6d80 x1875495932364160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788612838.037263:0:22774:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788612838.037382:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612838.037386:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612838.037388:0:22774:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788612838.037391:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788612838.037394:0:22774:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788612838.037395:0:22774:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788612838.037397:0:22774:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788612838.037398:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788612838.037401:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612838.037402:0:22774:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788612838.037405:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788612838.037409:0:22774:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788612838.037413:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612838.037414:0:22774:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788612838.037417:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788612838.037421:0:22774:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:2.0:1788612838.037447:0:22774:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788612838.037450:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788612838.037462:0:22774:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9612fcfc3380) 00000020:00000080:2.0:1788612838.037500:0:22774:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788612838.037506:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788612838.037820:0:22774:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788612838.037826:0:22774:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788612838.037832:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1f8616bf0bc99f9 00010000:00080000:2.0:1788612838.037859:0:22774:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9612c82bb800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1788612838.038061:0:22774:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788612838.038129:0:22774:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788612838.038144:0:22774:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788612838.038520:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932364160:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788612838.038947:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932364160 offset 0 length 520: 4 00000040:00080000:2.0:1788612838.040942:0:22774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612838.041148:0:22774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788612838.041301:0:22774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1788612838.042009:0:22782:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788612838.042015:0:22782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788612838.042946:0:22774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788612838.042962:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788612838.043001:0:22774:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788612838.043021:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc9a00 00000100:00080000:2.0:1788612838.043033:0:22774:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788612838.043039:0:22774:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9612c82bb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788612838.043077:0:22774:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fccc4a80 x1875495932364288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788612838.043105:0:22774:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788612838.043174:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612838.043179:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612838.043181:0:22774:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788612838.043184:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612838.043188:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612838.043190:0:22774:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788612838.043193:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788612838.043195:0:22774:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788612838.043197:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612838.043200:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612838.043201:0:22774:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788612838.043204:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612838.043206:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612838.043208:0:22774:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788612838.043211:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788612838.043244:0:22774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6b44f55-8b88-4406-a946-d178714afb91:22774:1875495932364416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612838.043325:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612838.043356:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c370d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788612838.043667:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932364416 00000100:00100000:0.0:1788612838.043674:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932364416 00000100:00100000:0.0:1788612838.043719:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788612838.043729:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+9:22774:x1875495932364416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788612838.043854:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+9:22774:x1875495932364416:12345-0@lo:502:llog_process_th.0 Request processed in 125us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612838.043862:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788612838.043905:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932364288:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788612838.043929:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932364288 offset 0 length 520: 4 00000100:00100000:0.0:1788612838.043970:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6b44f55-8b88-4406-a946-d178714afb91:22774:1875495932364416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788612838.043997:0:22774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788612838.044002:0:22774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788612838.044004:0:22774:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788612838.044009:0:22774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788612838.044066:0:22735:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788612838.044087:0:22735:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788612838.044102:0:22735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d0400/0x1f8616bf0bc9974 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc997b expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.044111:0:22735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c13d0400/0x1f8616bf0bc9974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc997b expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612838.044119:0:22735:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9612e9172000 from 1 10000000:01000000:0.0:1788612838.044127:0:22735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788612838.044153:0:22735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc9a07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.044161:0:22735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc9a07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.044170:0:22735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc9a07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612838.044184:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932364544:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788612838.044212:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612838.044233:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d1fe8840 going to sleep for 11 seconds 00000100:00100000:2.0:1788612838.044431:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932364544 00000100:00100000:2.0:1788612838.044436:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932364544 00000100:00100000:2.0:1788612838.044457:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788612838.044465:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+9:22735:x1875495932364544:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612838.044508:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612838.044521:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc9a0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9a07 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612838.044681:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc9a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9a07 expref: 10 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612838.044694:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc9a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9a07 expref: 10 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612838.044704:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b37a00, rc 0) 00000100:00100000:2.0:1788612838.044754:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+10:22735:x1875495932364544:12345-0@lo:101:mount.lustre.0 Request processed in 281us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612838.044761:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788612838.044835:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932364544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612838.044848:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc9a07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a0e expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612838.044857:0:22735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc9a07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9a0e expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612838.045376:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932364672:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788612838.045418:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612838.045520:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0dcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612838.045794:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932364672 00000100:00100000:2.0:1788612838.045800:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932364672 00000100:00100000:2.0:1788612838.045826:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788612838.045833:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+10:22735:x1875495932364672:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788612838.045847:0:22750:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788612838.045852:0:22750:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788612838.045921:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+10:22735:x1875495932364672:12345-0@lo:256:mount.lustre.0 Request processed in 88us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612838.045928:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788612838.046056:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932364672:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788612838.046896:0:22735:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788612838.047024:0:22735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc9a07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a0e expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612838.047037:0:22735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc9a07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a0e expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612838.047155:0:22735:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612e9172000 from 1 10000000:01000000:0.0:1788612838.047159:0:22735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612838.047192:0:22735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc9a15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.047201:0:22735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc9a15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.047211:0:22735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc9a15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612838.047230:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932364800:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788612838.047279:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612838.047349:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d1fe8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612838.047384:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932364800 00000100:00100000:2.0:1788612838.047391:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932364800 00000100:00100000:2.0:1788612838.047463:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788612838.047472:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+10:22735:x1875495932364800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612838.047512:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612838.047534:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612f7b36c00/0x1f8616bf0bc9a1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9a15 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612838.047847:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612f7b36c00/0x1f8616bf0bc9a1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9a15 expref: 11 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612838.047858:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612f7b36c00/0x1f8616bf0bc9a1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9a15 expref: 11 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612838.047867:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36c00, rc 0) 00000100:00100000:2.0:1788612838.047916:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+11:22735:x1875495932364800:12345-0@lo:101:mount.lustre.0 Request processed in 445us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612838.047923:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788612838.047990:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932364800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612838.048004:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc9a15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a1c expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612838.048014:0:22735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc9a15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9a1c expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612838.048078:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932364928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612838.048108:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612838.048371:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932364928 00000100:00100000:0.0:1788612838.048376:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932364928 00000100:00100000:0.0:1788612838.048401:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788612838.048408:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+11:22735:x1875495932364928:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612838.048673:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+11:22735:x1875495932364928:12345-0@lo:501:mount.lustre.0 Request processed in 265us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612838.048681:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788612838.048850:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0dcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788612838.048865:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932364928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612838.048900:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc717100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932365056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612838.048937:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612838.048984:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612838.049018:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932365056 00000100:00100000:0.0:1788612838.049022:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932365056 00000100:00100000:0.0:1788612838.049074:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788612838.049081:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+11:22735:x1875495932365056:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788612838.049161:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+11:22735:x1875495932365056:12345-0@lo:503:mount.lustre.0 Request processed in 80us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612838.049167:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788612838.049227:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc717100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932365056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612838.049532:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc717100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6b44f55-8b88-4406-a946-d178714afb91:22784:1875495932365184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612838.049579:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612838.049949:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932365184 00000100:00100000:2.0:1788612838.049954:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932365184 00000100:00100000:2.0:1788612838.049974:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788612838.049980:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+11:22784:x1875495932365184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612838.050300:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+11:22784:x1875495932365184:12345-0@lo:502:llog_process_th.0 Request processed in 319us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612838.050307:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788612838.050401:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788612838.050416:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc717100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6b44f55-8b88-4406-a946-d178714afb91:22784:1875495932365184:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788612838.050437:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612838.050444:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612838.050447:0:22784:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788612838.050452:0:22784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9612e9172000 00000020:00000080:3.0:1788612838.050454:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612838.050461:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612838.050463:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612838.050465:0:22784:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788612838.050467:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612838.050469:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612838.050470:0:22784:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788612838.050703:0:22784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9612e9172000 00000020:00000080:3.0:1788612838.050706:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612838.050804:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612838.050808:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612838.050810:0:22784:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788612838.050812:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612838.050814:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612838.050821:0:22784:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788612838.050825:0:22784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9612e9172000 00000020:00000080:3.0:1788612838.050827:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612838.051687:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612838.051693:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612838.051695:0:22784:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788612838.051697:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612838.051700:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612838.051701:0:22784:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788612838.051704:0:22784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9612e9172000 00000020:00000080:3.0:1788612838.051706:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788612838.051765:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc717100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6b44f55-8b88-4406-a946-d178714afb91:22784:1875495932365312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612838.051824:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612838.051904:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788612838.061692:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932365312 00000100:00100000:2.0:1788612838.061704:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932365312 00000100:00100000:2.0:1788612838.061769:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788612838.061779:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+11:22784:x1875495932365312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612838.061943:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+11:22784:x1875495932365312:12345-0@lo:502:llog_process_th.0 Request processed in 165us (10117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612838.061950:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788612838.063710:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc717100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6b44f55-8b88-4406-a946-d178714afb91:22784:1875495932365312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788612838.063768:0:22784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612838.063776:0:22784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612838.063778:0:22784:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788612838.063783:0:22784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788612838.067280:0:22735:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788612838.067354:0:22735:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788612838.067384:0:22735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc9a15 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a1c expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612838.067396:0:22735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc9a15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a1c expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612838.067468:0:22735:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788612838.067472:0:22735:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9612e9172000 10000000:01000000:1.0:1788612838.067503:0:22735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9612e9172000 10000000:01000000:1.0:1788612838.067508:0:22735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788612838.067514:0:22735:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9612e9172000 from 1 10000000:01000000:1.0:1788612838.067518:0:22735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788612838.067620:0:22735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1800/0x1f8616bf0bc9a23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612838.067629:0:22735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c13d1800/0x1f8616bf0bc9a23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612838.067641:0:22735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c13d1800/0x1f8616bf0bc9a23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612838.067668:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932365440:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788612838.067734:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612838.067790:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0dc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612838.076021:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932365440 00000100:00100000:3.0:1788612838.076035:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932365440 00000100:00100000:3.0:1788612838.076134:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788612838.076143:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+11:22735:x1875495932365440:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612838.076158:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612838.076174:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612e81da200/0x1f8616bf0bc9a2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9a23 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612838.076200:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612e81da200/0x1f8616bf0bc9a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9a23 expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612838.076211:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612e81da200/0x1f8616bf0bc9a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9a23 expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612838.076219:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612e81da200, rc 0) 00000100:00100000:3.0:1788612838.076282:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+12:22735:x1875495932365440:12345-0@lo:101:mount.lustre.0 Request processed in 140us (8547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612838.076301:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788612838.076462:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932365440:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612838.076508:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c13d1800/0x1f8616bf0bc9a23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a2a expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612838.076517:0:22735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c13d1800/0x1f8616bf0bc9a23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9a2a expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612838.076597:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932365568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612838.076628:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612838.076652:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0dc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612838.078717:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932365568 00000100:00100000:3.0:1788612838.078728:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932365568 00000100:00100000:3.0:1788612838.078785:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788612838.078794:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+12:22735:x1875495932365568:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612838.078963:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+12:22735:x1875495932365568:12345-0@lo:501:mount.lustre.0 Request processed in 169us (2333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612838.078971:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788612838.079066:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932365568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612838.079112:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932365696:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612838.079165:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612838.079201:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0dc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612838.079245:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932365696 00000100:00100000:3.0:1788612838.079249:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932365696 00000100:00100000:3.0:1788612838.079273:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788612838.079280:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+12:22735:x1875495932365696:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612838.079368:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+12:22735:x1875495932365696:12345-0@lo:503:mount.lustre.0 Request processed in 88us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612838.079375:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788612838.079448:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932365696:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612838.080317:0:22788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc716300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6b44f55-8b88-4406-a946-d178714afb91:22788:1875495932365824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612838.080368:0:22788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612838.080397:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932365824 00000100:00100000:3.0:1788612838.080402:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932365824 00000100:00100000:3.0:1788612838.080433:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788612838.080441:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+12:22788:x1875495932365824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612838.080565:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+12:22788:x1875495932365824:12345-0@lo:502:llog_process_th.0 Request processed in 112us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612838.080574:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788612838.080617:0:22788:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c696a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788612838.080639:0:22788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc716300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6b44f55-8b88-4406-a946-d178714afb91:22788:1875495932365824:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788612838.080692:0:22788:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788612838.080708:0:22788:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9611c64b8000) 00000020:00000080:3.0:1788612838.080725:0:22788:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788612838.080823:0:22788:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9612e9172000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788612838.080827:0:22788:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9612e9172000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788612838.080829:0:22788:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9612e9172000 4 00010000:00080000:3.0:1788612838.080865:0:22788:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9611c7935800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1788612838.090369:0:22788:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788612838.096448:0:22788:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788612838.096518:0:22788:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788612838.096532:0:22788:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1f8616bf0bc9a38 00000100:00080000:2.0:1788612838.098652:0:22788:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788612838.098665:0:22788:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9611c7935800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788612838.098704:0:22788:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fccc5c00 x1875495932365952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788612838.098730:0:22788:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788612838.099184:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875495932365952:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788612838.099252:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612838.100440:0:22788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6b44f55-8b88-4406-a946-d178714afb91:22788:1875495932366080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612838.100522:0:22788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612838.100549:0:22788:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c370d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612838.100709:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932366080 00000100:00100000:3.0:1788612838.100717:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932366080 00000100:00100000:3.0:1788612838.100767:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788612838.100777:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+12:22788:x1875495932366080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612838.100891:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+12:22788:x1875495932366080:12345-0@lo:502:llog_process_th.0 Request processed in 115us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612838.100901:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788612838.100981:0:22788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6b44f55-8b88-4406-a946-d178714afb91:22788:1875495932366080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612838.101022:0:22788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6b44f55-8b88-4406-a946-d178714afb91:22788:1875495932366208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788612838.101053:0:22788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612838.101082:0:22788:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c370d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612838.101216:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932366208 00000100:00100000:3.0:1788612838.101221:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932366208 00000100:00100000:3.0:1788612838.101251:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788612838.101258:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+12:22788:x1875495932366208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788612838.101317:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+12:22788:x1875495932366208:12345-0@lo:502:llog_process_th.0 Request processed in 59us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612838.101325:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788612838.101396:0:22788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6b44f55-8b88-4406-a946-d178714afb91:22788:1875495932366208:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788612838.101415:0:22788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788612838.102409:0:22735:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788612838.102438:0:22735:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788612838.102460:0:22735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1800/0x1f8616bf0bc9a23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a2a expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612838.102518:0:22735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c13d1800/0x1f8616bf0bc9a23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a2a expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788612838.102635:0:22735:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788612838.102637:0:22735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788612838.102639:0:22735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612838.102640:0:22735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612838.102642:0:22735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612838.102643:0:22735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612838.102645:0:22735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788612838.102647:0:22735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788612838.102648:0:22735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612838.102650:0:22735:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788612838.102654:0:22735:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788612838.102656:0:22735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788612838.102658:0:22735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788612838.102659:0:22735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612838.102660:0:22735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612838.102661:0:22735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612838.102662:0:22735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612838.102663:0:22735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788612838.102665:0:22735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788612838.102665:0:22735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612838.102667:0:22735:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788612838.102685:0:22735:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788612838.102698:0:22735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc716300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932366336:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788612838.102757:0:22735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612838.102791:0:22735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcdb20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612838.102877:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932366336 00000100:00100000:2.0:1788612838.102883:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932366336 00000100:00100000:2.0:1788612838.102917:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788612838.102926:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+12:22735:x1875495932366336:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788612838.102957:0:22751:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788612838.102971:0:22751:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788612838.105032:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932365952 00000100:00100000:0.0:1788612838.105046:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932365952 00000100:00100000:0.0:1788612838.105078:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612838.105086:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932365952:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788612838.105175:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932365952:12345-0@lo:38:llog_process_th.0 Request processed in 88us (5922us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788612838.105183:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612838.105225:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788612838.105234:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c7935800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612838.105238:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788612838.105242:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875495932365952:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1788612838.110930:0:22751:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788612838.110949:0:22751:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788612838.111376:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+12:22735:x1875495932366336:12345-0@lo:253:mount.lustre.0 Request processed in 8446us (8613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612838.111388:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:0.0:1788612838.111506:0:22772:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788612838.111511:0:22772:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788612838.111535:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a3f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.111550:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc9a0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9a07 expref: 11 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.111624:0:22772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a3f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.111663:0:22772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc9a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9a07 expref: 11 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.111680:0:22772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc9a0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9a07 expref: 11 pid: 22750 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612838.111695:0:22772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbe300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1875495932366464:0@lo:104: 00000100:00100000:0.0:1788612838.111731:0:22772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612838.111779:0:22772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcd78480 going to sleep for 11 seconds 00000100:00100000:0.0:1788612838.111820:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932366464 00000100:00100000:0.0:1788612838.111828:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932366464 00000100:00100000:0.0:1788612838.111866:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612838.111874:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6b44f55-8b88-4406-a946-d178714afb91+3:22772:x1875495932366464:12345-0@lo:104: 00010000:00010000:0.0:1788612838.111887:0:22739:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc9a07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9a0e expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.111925:0:22739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788612838.111931:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6b44f55-8b88-4406-a946-d178714afb91+3:22772:x1875495932366464:12345-0@lo:104: Request processed in 58us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612838.111938:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612838.111970:0:22772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbe300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1875495932366464:0@lo:104: 00010000:00010000:0.0:1788612838.111987:0:22772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a3f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612838.112079:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612838.112086:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc9a07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9a0e expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612838.112100:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2200 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612838.112104:0:22745:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc9a07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc9a0e expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612838.112112:0:22745:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc9a07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc9a0e expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612838.112120:0:22745:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc9a07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc9a0e expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612838.112126:0:22745:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788612838.112158:0:22745:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc9a07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9a0e expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612838.112165:0:22745:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612838.112183:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc9a07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9a0e expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612838.112191:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a2200/0x1f8616bf0bc9a07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9a0e expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612838.112208:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612838.112210:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612838.112212:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612838.112241:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6b44f55-8b88-4406-a946-d178714afb91:3649:1875495932366592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612838.112268:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612838.112358:0:22735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc716300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:22735:1875495932366336:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788612838.112368:0:22735:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788612838.112371:0:22735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788612838.112373:0:22735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788612838.112375:0:22735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612838.112376:0:22735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612838.112377:0:22735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612838.112379:0:22735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612838.112380:0:22735:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788612838.112382:0:22735:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788612838.112384:0:22735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612838.112385:0:22735:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788612838.112395:0:22735:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788612838.113026:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932366592 00000100:00100000:0.0:1788612838.113036:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932366592 00010000:00010000:0.0:1788612838.113057:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc9a0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9a07 expref: 12 pid: 22750 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612838.113082:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612838.113089:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc716a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6b44f55-8b88-4406-a946-d178714afb91+12:3649:x1875495932366592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612838.113100:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612838.113105:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc9a0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9a07 expref: 12 pid: 22750 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.113117:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc9a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9a07 expref: 12 pid: 22750 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.113131:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc9a0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9a07 expref: 12 pid: 22750 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.113145:0:22741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a3f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.113154:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a3f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788612838.113166:0:22741:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001655741s 00010000:00010000:0.0:1788612838.113171:0:22741:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a3f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.113178:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a3f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.113186:0:22741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a3f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.113202:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a3f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.113209:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3400 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612838.113213:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a3f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.113222:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a3f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.113235:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a3f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.113246:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612838.113285:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc716a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6b44f55-8b88-4406-a946-d178714afb91+11:3649:x1875495932366592:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612838.113293:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788612838.113315:0:22772:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a3f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.113324:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a3f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.113331:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a3f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612838.113364:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6b44f55-8b88-4406-a946-d178714afb91:3649:1875495932366592:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788612838.139355:0:22735:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:3.0:1788612838.139762:0:22735:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788612838.139998:0:22795:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:1.0:1788612838.140003:0:22795:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:0.0:1788612838.140064:0:22796:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1788612838.140337:0:22796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788612838.143116:0:22796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788612838.143200:0:22796:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1788612838.143421:0:22735:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1788612838.144439:0:22797:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9612fc76f800 x1875495932366720/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612838.144453:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 0 seconds 00000040:01000000:2.0:1788612838.145025:0:22735:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788612838.145060:0:22735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788612838.145774:0:22735:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788612838.145785:0:22735:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788612838.145836:0:22735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612838.147049:0:22735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788612838.148170:0:22735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788612838.148239:0:22735:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788612838.149266:0:22735:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1788612838.149955:0:22735:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1788612838.151782:0:22735:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788612838.152985:0:22735:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788612838.153021:0:22735:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa9b940ddb988 00100000:10000000:2.0:1788612838.153030:0:22735:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788612838.153887:0:22735:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788612838.153906:0:22735:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788612838.153929:0:22735:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788612838.153945:0:22735:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788612838.158428:0:22735:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788612838.158795:0:22735:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788612838.768309:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788612838.840826:0:22753:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788612838.840833:0:22753:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9612e9172000 from 11 10000000:01000000:3.0:1788612838.840838:0:22753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788612838.840881:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612e81dba00/0x1f8616bf0bc9a46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612838.840894:0:22753:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612e81dba00/0x1f8616bf0bc9a46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612838.840905:0:22753:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612e81dba00/0x1f8616bf0bc9a46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612838.840929:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932366848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788612838.840999:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612838.841050:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcdb2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612838.841103:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932366848 00000100:00100000:0.0:1788612838.841111:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932366848 00000100:00100000:0.0:1788612838.841192:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788612838.841202:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+11:22753:x1875495932366848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612838.841214:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612838.841228:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9a46 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.841253:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9a46 expref: 12 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.841262:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9a46 expref: 12 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612838.841271:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3400, rc 0) 00000100:00100000:0.0:1788612838.841319:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+12:22753:x1875495932366848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612838.841325:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788612838.841789:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932366848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612838.841808:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612e81dba00/0x1f8616bf0bc9a46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a4d expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612838.841819:0:22753:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612e81dba00/0x1f8616bf0bc9a46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9a4d expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612838.841875:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932366976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788612838.841911:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612838.841937:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932366976 00000100:00100000:3.0:1788612838.841941:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932366976 00000100:00100000:3.0:1788612838.841973:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788612838.841979:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+12:22753:x1875495932366976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788612838.841995:0:22751:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788612838.842010:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788612838.842013:0:22751:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788612838.842080:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+12:22753:x1875495932366976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612838.842087:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788612838.842110:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcdb2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788612838.842120:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932366976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788612838.842158:0:22753:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788612838.842164:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612e81dba00/0x1f8616bf0bc9a46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a4d expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612838.842173:0:22753:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612e81dba00/0x1f8616bf0bc9a46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a4d expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612839.151680:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 0 seconds 00000040:00080000:1.0:1788612839.160013:0:22790:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788612839.160026:0:22790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788612839.161212:0:22790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788612839.161223:0:22790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788612839.791985:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788612840.175788:0:22790:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788612840.175797:0:22790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788612840.175913:0:22790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1788612840.175954:0:22790:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788612840.177283:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 0 seconds 00000040:00080000:1.0:1788612840.185365:0:22790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:2.0:1788612840.815852:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612841.208679:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 0 seconds 00010000:00010000:3.0:1788612841.840648:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612842.224150:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 0 seconds 00000001:02000400:3.0:1788612842.474234:0:23040:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788612842.863663:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612843.251449:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 0 seconds 00000100:00080000:1.0:1788612843.505419:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788612843.505426:0:15779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788612843.505436:0:15779:0:(import.c:65:import_set_state_nolock()) ffff9612fccfc000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612843.505444:0:15779:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 652 00000100:00080000:1.0:1788612843.505450:0:15779:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788612843.505463:0:15779:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9612fccfc000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612843.505542:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6b44f55-8b88-4406-a946-d178714afb91:3650:1875495932367104:0@lo:400:kworker.0 00000100:00100000:0.0:1788612843.505602:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612843.505659:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932367104 00000100:00100000:0.0:1788612843.505666:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932367104 00000100:00100000:0.0:1788612843.505724:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788612843.505733:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+12:3650:x1875495932367104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612843.505739:0:15779:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc76c380 x1875495932367232/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612843.505775:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+12:3650:x1875495932367104:12345-0@lo:400:kworker.0 Request processed in 43us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612843.505791:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788612843.505838:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6b44f55-8b88-4406-a946-d178714afb91:3650:1875495932367104:0@lo:400:kworker.0 00000100:00100000:0.0:1788612843.505920:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932367232:0@lo:38:kworker.0 00000100:00100000:0.0:1788612843.505954:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788612843.505986:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612843.505990:0:15779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788612843.505992:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612843.505995:0:15779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788612843.505997:0:15779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788612843.505999:0:15779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788612843.506001:0:15779:0:(import.c:65:import_set_state_nolock()) ffff9611c7935800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612843.506006:0:15779:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9611c7935800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612843.506018:0:15779:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc76ea00 x1875495932367360/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612843.506103:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875495932367360:0@lo:38:kworker.0 00000100:00100000:0.0:1788612843.506126:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612843.506156:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932367232 00000100:00100000:0.0:1788612843.506159:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932367232 00000100:00100000:0.0:1788612843.506178:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612843.506183:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875495932367232:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788612843.506199:0:22762:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788612843.506238:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875495932367232:12345-0@lo:38:kworker.0 Request processed in 53us (281us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788612843.506240:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932367360 00000100:00100000:3.0:1788612843.506246:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932367360 00000100:00100000:0.0:1788612843.506259:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612843.506269:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612843.506275:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932367360:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788612843.506292:0:22758:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 657 last 0 00000100:00080000:0.0:1788612843.506301:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612fccfc000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612843.506307:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788612843.506311:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932367232:0@lo:38:kworker.0 00000020:00000080:3.0:1788612843.506327:0:22758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1f8616bf0bc9a54 00000004:00100000:3.0:1788612843.506347:0:22758:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788612843.506457:0:22758:0:(import.c:65:import_set_state_nolock()) ffff9612c7231800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612843.506525:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875495932367360:12345-0@lo:38:kworker.0 Request processed in 248us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612843.506532:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788612843.506548:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9612fc76ea00 x1875495932367360/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788612843.506560:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788612843.506566:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788612843.506570:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788612843.506572:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c7935800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788612843.506576:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875495932367360:0@lo:38:kworker.0 00000020:00000004:1.0:1788612843.520895:0:23092:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788612843.521181:0:23092:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788612843.887723:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612844.275796:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 0 seconds 00000020:00000004:3.0:1788612844.337420:0:23142:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788612844.337767:0:23142:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788612844.913685:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612845.295914:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 0 seconds 00010000:00010000:3.0:1788612845.936614:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612846.319533:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 0 seconds 00010000:00010000:2.0:1788612846.964105:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612847.343774:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 0 seconds 00010000:00010000:0.0:1788612847.983778:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612848.368082:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 0 seconds 00000100:00100000:1.0:1788612848.623598:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612838/real 1788612838] req@ffff9612fccc4a80 x1875495932364288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612848 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612848.623636:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9612fccc4a80 x1875495932364288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612848 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612848.623647:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612838/real 1788612838] req@ffff9612fccc6d80 x1875495932364160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612848 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612848.623657:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9612fccc6d80 x1875495932364160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612848 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788612848.623691:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788612848.623696:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788612848.623700:0:8:0:(import.c:65:import_set_state_nolock()) ffff9612fccfc000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612848.623701:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612c82bb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788612848.623705:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 657 00000100:00080000:3.0:1788612848.623712:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788612848.623715:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00080000:3.0:1788612848.623720:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9612fccfc000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612848.623720:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932364288:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788612848.623725:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c80c2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788612848.623732:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788612848.623734:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932364160:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788612848.623743:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc715880 x1875495932367616/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612848.623752:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612848.623755:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788612848.623756:0:8:0:(import.c:65:import_set_state_nolock()) ffff9611c80c2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788612848.623848:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6b44f55-8b88-4406-a946-d178714afb91:3651:1875495932367488:0@lo:400:kworker.0 00000100:00100000:2.0:1788612848.623925:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612848.623998:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932367488 00000100:00100000:2.0:1788612848.624007:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932367488 00000100:00100000:2.0:1788612848.624056:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788612848.624165:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932367616:0@lo:38:kworker.0 00000100:00100000:1.0:1788612848.624207:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788612848.624415:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 652 00000100:00080000:3.0:1788612848.624420:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788612848.624425:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9611c80c2800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612848.624445:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc715500 x1875495932367744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612848.624456:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612848.624466:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788612848.624468:0:8:0:(import.c:65:import_set_state_nolock()) ffff9612c82bb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612848.624472:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 652 00000100:00080000:3.0:1788612848.624581:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788612848.624586:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9612c82bb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612848.624601:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc716d80 x1875495932367872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612848.624642:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612848.624654:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932368000:0@lo:400:kworker.0 00000100:00100000:0.0:1788612848.624704:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612848.624821:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932368000 00000100:00100000:3.0:1788612848.624826:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932368000 00000100:00100000:3.0:1788612848.624862:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612848.624871:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932368000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612848.624930:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932368000:12345-0@lo:400:kworker.0 Request processed in 59us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612848.624937:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788612848.624981:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9612fc715180 x1875495932368000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612848.624993:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932368000:0@lo:400:kworker.0 00000100:00100000:1.0:1788612848.625208:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932367744:0@lo:8:kworker.0 00000400:00000100:1.0:1788612848.625301:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932367744 offset 0 length 520: 4 00000100:00100000:1.0:1788612848.625326:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932367872:0@lo:8:kworker.0 00000400:00000100:1.0:1788612848.625348:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932367872 offset 0 length 520: 4 00000100:00100000:1.0:1788612848.625387:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932367616 00000100:00100000:1.0:1788612848.625391:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932367616 00000100:00100000:1.0:1788612848.625417:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612848.625423:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875495932367616:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788612848.625443:0:22762:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788612848.625501:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875495932367616:12345-0@lo:38:kworker.0 Request processed in 77us (1293us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788612848.625508:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788612848.625541:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612fccfc000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788612848.625547:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788612848.625550:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932367616:0@lo:38:kworker.0 00000100:00100000:2.0:1788612848.625666:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+12:3651:x1875495932367488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612848.625724:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+12:3651:x1875495932367488:12345-0@lo:400:kworker.0 Request processed in 63us (1799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612848.625731:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788612848.625958:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6b44f55-8b88-4406-a946-d178714afb91:3651:1875495932367488:0@lo:400:kworker.0 00010000:00010000:2.0:1788612849.007866:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612849.391829:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 0 seconds 00010000:00010000:0.0:1788612850.031873:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612850.416813:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 0 seconds 00000040:00080000:1.0:1788612850.424404:0:22790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1788612850.560758:0:23489:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788612850.560762:0:23489:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788612850.560764:0:23489:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788612850.560870:0:23489:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9611c6492800 00000020:01000004:2.0:1788612850.560884:0:23489:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788612850.560896:0:23489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788612850.560910:0:23489:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9612fcfc0000) 00000020:00000080:2.0:1788612850.560926:0:23489:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788612850.668248:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788612850.676780:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1788612850.680759:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788612850.681877:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788612850.682420:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788612850.682818:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1788612850.683017:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1788612850.683208:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788612850.683390:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788612850.684985:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788612850.685340:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788612850.685673:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788612850.685956:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1788612850.686138:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788612850.688815:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788612850.689030:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788612850.689214:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788612850.689393:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788612850.690584:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788612850.690985:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1788612850.691306:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788612850.691550:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788612850.691866:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1788612850.692307:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788612850.700579:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788612850.700966:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788612850.701172:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788612850.701345:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788612850.701989:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788612850.702243:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788612850.702939:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788612850.703652:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788612850.703904:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788612850.704127:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788612850.704406:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788612850.704948:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788612850.705617:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788612850.705985:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788612850.707646:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788612850.707997:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788612850.708409:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788612850.708901:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788612850.711866:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788612850.714637:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788612850.715142:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788612850.715618:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00080000:01000000:3.0:1788612850.719049:0:23489:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788612850.719266:0:23489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788612850.719277:0:23489:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788612850.719290:0:23489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1f8616bf0bc9a62 00000020:01000004:3.0:1788612850.719298:0:23489:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788612850.719317:0:23489:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788612850.719321:0:23489:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788612850.719328:0:23489:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788612850.719354:0:23489:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788612850.719358:0:23489:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788612850.730752:0:23489:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788612850.730798:0:23489:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.130@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788612850.730802:0:23489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788612850.730804:0:23489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788612850.730805:0:23489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612850.730807:0:23489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612850.730808:0:23489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612850.730810:0:23489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612850.730811:0:23489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788612850.730812:0:23489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612850.730814:0:23489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788612850.730818:0:23489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788612850.730820:0:23489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788612850.730822:0:23489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788612850.730823:0:23489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612850.730824:0:23489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612850.730825:0:23489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612850.730826:0:23489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612850.730827:0:23489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788612850.730828:0:23489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612850.730829:0:23489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788612850.730855:0:23489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788612850.730877:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932368128:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788612850.730951:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612850.731049:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcf26300 going to sleep for 11 seconds 00000100:00100000:0.0:1788612850.731097:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932368128 00000100:00100000:0.0:1788612850.731105:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932368128 00000100:00100000:0.0:1788612850.731189:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788612850.731199:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+12:23489:x1875495932368128:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788612850.731228:0:22750:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788612850.731231:0:22750:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788612850.731239:0:22750:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788612850.731677:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+12:23489:x1875495932368128:12345-0@lo:253:mount.lustre.0 Request processed in 478us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612850.731685:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788612850.731735:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932368128:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788612850.731748:0:23489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788612850.731751:0:23489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788612850.731753:0:23489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788612850.731754:0:23489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788612850.731755:0:23489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788612850.731756:0:23489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788612850.731757:0:23489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788612850.731759:0:23489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788612850.731760:0:23489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788612850.731762:0:23489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788612850.731793:0:23489:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9611c6492800 from lustre-MDT0001 10000000:01000000:1.0:1788612850.731822:0:23489:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788612850.731825:0:23489:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788612850.731832:0:23489:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9612d1e63380 local copy 00010000:00010000:1.0:1788612850.731841:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612e81dae00/0x1f8616bf0bc9958 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc995f expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612850.731925:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932368256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612850.731973:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612850.732006:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0904d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788612850.732286:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932368256 00000100:00100000:2.0:1788612850.732291:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932368256 00000100:00100000:2.0:1788612850.732330:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788612850.732340:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+12:23489:x1875495932368256:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612850.732421:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+12:23489:x1875495932368256:12345-0@lo:501:mount.lustre.0 Request processed in 82us (447us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788612850.732454:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788612850.732715:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932368256:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788612850.732731:0:23489:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788612850.732754:0:23489:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788612850.732761:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612e81dae00/0x1f8616bf0bc9958 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc995f expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612850.732783:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612e81dae00/0x1f8616bf0bc9958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc995f expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612850.732827:0:23489:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9611c6492800 10000000:01000000:1.0:1788612850.732832:0:23489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788612850.732836:0:23489:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9612d1e63380 10000000:01000000:1.0:1788612850.732838:0:23489:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788612850.732842:0:23489:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9612d1e63380 from 1 10000000:01000000:1.0:1788612850.732845:0:23489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788612850.732870:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc9a69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612850.732878:0:23489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc9a69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612850.732888:0:23489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc9a69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612850.732902:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932368384:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788612850.733649:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612850.733694:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0904d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788612850.734591:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932368384 00000100:00100000:0.0:1788612850.734601:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932368384 00000100:00100000:0.0:1788612850.734652:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788612850.734674:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+12:23489:x1875495932368384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788612850.734689:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612850.734708:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a3000/0x1f8616bf0bc9a70 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9a69 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612850.734733:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a3000/0x1f8616bf0bc9a70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9a69 expref: 13 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612850.734759:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a3000/0x1f8616bf0bc9a70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9a69 expref: 13 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612850.734779:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3000, rc 0) 00000100:00100000:0.0:1788612850.734841:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+13:23489:x1875495932368384:12345-0@lo:101:mount.lustre.0 Request processed in 169us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612850.734848:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788612850.737989:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932368384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612850.738019:0:23489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc9a69 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a70 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612850.738032:0:23489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc9a69 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9a70 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612850.738058:0:23489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788612850.738078:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc9a69 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a70 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612850.738170:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c13d1200/0x1f8616bf0bc9a69 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a70 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612850.738306:0:23489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9611c6492800 10000000:01000000:1.0:1788612850.738313:0:23489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788612850.738319:0:23489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9611c6492800 from 1 10000000:01000000:1.0:1788612850.738322:0:23489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788612850.738358:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc9a77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612850.738365:0:23489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc9a77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612850.738373:0:23489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc9a77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612850.738392:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932368512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788612850.738795:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612850.738839:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0904d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788612850.738877:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932368512 00000100:00100000:2.0:1788612850.738885:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932368512 00000100:00100000:2.0:1788612850.738927:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788612850.738935:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+13:23489:x1875495932368512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612850.738947:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612850.738959:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612f7b37c00/0x1f8616bf0bc9a7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9a77 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612850.738980:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612f7b37c00/0x1f8616bf0bc9a7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9a77 expref: 14 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612850.738990:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612f7b37c00/0x1f8616bf0bc9a7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9a77 expref: 14 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612850.738996:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b37c00, rc 0) 00000100:00100000:2.0:1788612850.739047:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+14:23489:x1875495932368512:12345-0@lo:101:mount.lustre.0 Request processed in 112us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612850.739054:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788612850.739802:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932368512:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612850.739820:0:23489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc9a77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a7e expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612850.739830:0:23489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc9a77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9a7e expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612850.739846:0:23489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788612850.739864:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc9a77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a7e expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612850.739889:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c13d1c00/0x1f8616bf0bc9a77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a7e expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612850.739897:0:23489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788612850.739902:0:23489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788612850.739908:0:23489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9611c6492800 10000000:01000000:1.0:1788612850.739912:0:23489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788612850.739915:0:23489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788612850.739917:0:23489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788612850.739939:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc9a85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612850.739947:0:23489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc9a85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612850.739955:0:23489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc9a85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612850.739972:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932368640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788612850.740010:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612850.740044:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0904d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788612850.740169:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932368640 00000100:00100000:3.0:1788612850.740174:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932368640 00000100:00100000:3.0:1788612850.740218:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788612850.740227:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+14:23489:x1875495932368640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612850.740237:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612850.740249:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612e81da000/0x1f8616bf0bc9a8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9a85 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612850.740267:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612e81da000/0x1f8616bf0bc9a8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9a85 expref: 15 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612850.740284:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612e81da000/0x1f8616bf0bc9a8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9a85 expref: 15 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612850.740291:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612e81da000, rc 0) 00000100:00100000:3.0:1788612850.740339:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+15:23489:x1875495932368640:12345-0@lo:101:mount.lustre.0 Request processed in 111us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612850.740347:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788612850.740367:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932368640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612850.740380:0:23489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc9a85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a8c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612850.740389:0:23489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc9a85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9a8c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788612850.743682:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1788612850.746052:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612850.749905:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788612850.749963:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1788612850.749979:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1788612850.749992:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1788612850.750007:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1788612850.750022:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1788612850.750035:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1788612850.750047:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1788612850.750063:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1788612850.750078:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1788612850.750178:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1788612850.750271:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1788612850.750285:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1788612850.750297:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1788612850.750311:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1788612850.750323:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1788612850.750335:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1788612850.750347:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1788612850.750362:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1788612850.750376:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1788612850.750389:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1788612850.750403:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1788612850.750776:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1788612850.750795:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1788612850.750809:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1788612850.750822:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1788612850.750836:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1788612850.750849:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1788612850.750861:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1788612850.750873:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1788612850.750887:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1788612850.750900:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1788612850.750914:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1788612850.750929:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1788612850.750942:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1788612850.750955:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1788612850.750968:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1788612850.750979:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1788612850.750991:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1788612850.751004:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1788612850.751017:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1788612850.751031:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1788612850.751045:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1788612850.751070:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1788612850.751097:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1788612850.751306:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1788612850.751918:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932368768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612850.751984:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612850.752017:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6caf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612850.752090:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932368768 00000100:00100000:0.0:1788612850.752099:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932368768 00000100:00100000:0.0:1788612850.752193:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788612850.752203:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+15:23489:x1875495932368768:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612850.752349:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+15:23489:x1875495932368768:12345-0@lo:501:mount.lustre.0 Request processed in 147us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612850.752358:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788612850.752832:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932368768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612850.752872:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932368896:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612850.752921:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612850.753173:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fd6caf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788612850.753343:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932368896 00000100:00100000:3.0:1788612850.753350:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932368896 00000100:00100000:3.0:1788612850.753382:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788612850.753390:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+15:23489:x1875495932368896:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612850.754151:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+15:23489:x1875495932368896:12345-0@lo:503:mount.lustre.0 Request processed in 759us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612850.754161:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788612850.754367:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932368896:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788612850.754831:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788612850.754905:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932369024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612850.754955:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612850.754981:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c7260cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612850.755098:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932369024 00000100:00100000:3.0:1788612850.755108:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932369024 00000100:00100000:3.0:1788612850.755137:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788612850.755146:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+15:23489:x1875495932369024:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612850.756791:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+15:23489:x1875495932369024:12345-0@lo:502:mount.lustre.0 Request processed in 1638us (1828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612850.756804:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788612850.757323:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932369024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788612850.757757:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788612850.757790:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1788612850.757805:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1788612850.757819:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1788612850.757834:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1788612850.757846:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1788612850.757860:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1788612850.757887:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1788612850.757902:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1788612850.757914:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1788612850.757925:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1788612850.757937:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1788612850.757950:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1788612850.757964:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1788612850.757978:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1788612850.757990:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1788612850.758004:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1788612850.758017:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1788612850.758030:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1788612850.758042:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1788612850.758056:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1788612850.758069:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1788612850.758081:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1788612850.758097:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1788612850.758111:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1788612850.758121:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1788612850.758132:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1788612850.758143:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1788612850.758155:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1788612850.758167:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1788612850.758181:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1788612850.760076:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1788612850.760094:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1788612850.760109:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1788612850.760121:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1788612850.760135:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1788612850.760149:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1788612850.760163:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1788612850.760179:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1788612850.762396:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1788612850.762689:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1788612850.762704:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1788612850.762717:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1788612850.762730:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1788612850.762776:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc715180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932369152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612850.762855:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612850.762930:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcd78b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788612850.763029:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932369152 00000100:00100000:1.0:1788612850.763037:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932369152 00000100:00100000:2.0:1788612850.764358:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788612850.764372:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+15:23489:x1875495932369152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612850.765306:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+15:23489:x1875495932369152:12345-0@lo:502:mount.lustre.0 Request processed in 933us (2446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612850.765316:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788612850.765797:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc715180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932369152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788612850.765878:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:0.0:1788612850.765892:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788612850.767143:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612850.767157:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612850.767160:0:23493:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788612850.767165:0:23493:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788612850.767168:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788612850.767290:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9612d1e619c0) 00000020:00000080:1.0:1788612850.767312:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788612850.767320:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788612850.767405:0:23493:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788612850.768382:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1f8616bf0bc9a9a 00000020:00000080:1.0:1788612850.768937:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788612850.768945:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612850.768949:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612850.768951:0:23493:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788612850.768954:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612850.768959:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612850.768960:0:23493:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788612850.768963:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788612850.768974:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9611c69d4d40) 00000020:00000080:1.0:1788612850.768987:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788612850.768991:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788612850.768993:0:23493:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788612850.768996:0:23493:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788612850.769002:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788612850.769058:0:23493:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9611c6492800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788612850.769069:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9611c69d3380) 00000020:00000080:1.0:1788612850.769078:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788612850.769138:0:23493:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788612850.769143:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc9aaf 00000020:00000080:1.0:1788612850.773925:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788612850.773942:0:23493:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788612850.773954:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x1f8616bf0bc9ab6 00080000:01000000:1.0:1788612850.773965:0:23493:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788612850.773970:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1f8616bf0bc9abd 00010000:00010000:2.0:1788612850.882059:0:23493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788612850.882691:0:23493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1788612850.883042:0:23493:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788612850.885251:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788612850.885264:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612850.885272:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612850.885274:0:23493:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788612850.885277:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612850.885282:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612850.885284:0:23493:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788612850.885287:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788612850.885292:0:23493:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:2.0:1788612850.885315:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788612850.885328:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9611c5a23380) 00000020:00000080:2.0:1788612850.885350:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1788612850.885354:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788612850.885420:0:23493:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788612850.885426:0:23493:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788612850.885432:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1f8616bf0bc9acb 00010000:00080000:2.0:1788612850.886573:0:23493:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9612fe89c800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1788612850.893784:0:23493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788612850.897169:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788612850.897183:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788612850.897219:0:23493:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788612850.897243:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc9ad2 00000100:00080000:3.0:1788612850.897254:0:23493:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788612850.897261:0:23493:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9612fe89c800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612850.897296:0:23493:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc715c00 x1875495932369280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788612850.897359:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932369280:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788612850.897440:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788612850.897644:0:23493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788612850.897705:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612850.897709:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612850.897711:0:23493:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788612850.897714:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788612850.897717:0:23493:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788612850.897718:0:23493:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788612850.897719:0:23493:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788612850.897721:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788612850.897724:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612850.897725:0:23493:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788612850.897727:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612850.897732:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612850.897734:0:23493:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788612850.897737:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788612850.897769:0:23493:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788612850.897795:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612850.897798:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612850.897800:0:23493:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788612850.897802:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788612850.897804:0:23493:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1788612850.897805:0:23493:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788612850.897807:0:23493:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788612850.897808:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788612850.897811:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612850.897812:0:23493:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788612850.897815:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788612850.897819:0:23493:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788612850.897821:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612850.897823:0:23493:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788612850.897826:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788612850.897829:0:23493:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:3.0:1788612850.897849:0:23493:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788612850.897852:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788612850.897864:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9611c64b99c0) 00000020:00000080:3.0:1788612850.897876:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788612850.897881:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788612850.897960:0:23493:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788612850.897967:0:23493:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788612850.897973:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1f8616bf0bc9ae0 00010000:00080000:3.0:1788612850.898002:0:23493:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9612fe89b800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1788612850.898217:0:23493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1788612850.899018:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932369280 00000100:00100000:2.0:1788612850.899027:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932369280 00000100:00100000:2.0:1788612850.899063:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788612850.899070:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875495932369280:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788612850.899095:0:22762:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:2.0:1788612850.899136:0:22762:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc9ae7 00000004:00100000:2.0:1788612850.899151:0:22762:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788612850.899157:0:22762:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:1.0:1788612850.903056:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788612850.903064:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788612850.903068:0:8:0:(import.c:65:import_set_state_nolock()) ffff9612fccfc000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612850.903077:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 663 00000100:00080000:1.0:1788612850.903083:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788612850.903090:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9612fccfc000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612850.903123:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc76fb80 x1875495932369408/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788612850.903155:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612850.903158:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788612850.903161:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612850.903163:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788612850.903363:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932369536:0@lo:400:kworker.0 00000100:00100000:2.0:1788612850.903433:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612850.903543:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932369536 00000100:00100000:2.0:1788612850.903550:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932369536 00000100:00100000:2.0:1788612850.903594:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788612850.903603:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932369536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612850.903652:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932369536:12345-0@lo:400:kworker.0 Request processed in 50us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612850.903674:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788612850.903710:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9612fc76df80 x1875495932369536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612850.903723:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932369536:0@lo:400:kworker.0 00000040:01000000:1.0:1788612850.904634:0:23493:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788612850.905023:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932369408:0@lo:38:kworker.0 00000100:00100000:0.0:1788612850.905078:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612850.905158:0:22761:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788612850.905167:0:22761:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000040:01000000:1.0:1788612850.905414:0:23493:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1788612850.905534:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932369408 00000100:00100000:0.0:1788612850.905542:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932369408 00000100:00100000:2.0:1788612850.906076:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788612850.906083:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1875495932369408:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788612850.906198:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1875495932369408:12345-0@lo:38:kworker.0 Request processed in 113us (1119us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788612850.906206:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788612850.906293:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788612850.906301:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612fccfc000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612850.906305:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788612850.906315:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932369408:0@lo:38:kworker.0 00000100:00080000:1.0:1788612850.908269:0:22762:0:(import.c:65:import_set_state_nolock()) ffff9612e0940800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612850.908349:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875495932369280:12345-0@lo:38:llog_process_th.0 Request processed in 9277us (10914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612850.908360:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788612850.908536:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788612850.908546:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788612850.908554:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788612850.908560:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788612850.908563:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612fe89c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788612850.908576:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932369280:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788612850.908725:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932369664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612850.908760:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612850.909032:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932369664 00000100:00100000:2.0:1788612850.909042:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932369664 00000100:00100000:2.0:1788612850.909086:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788612850.909096:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875495932369664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788612850.909120:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788612850.909207:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875495932369664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612850.909214:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788612850.909277:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932369664:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788612850.909760:0:23493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612850.911572:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788612850.911756:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788612850.912973:0:23499:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788612850.912979:0:23499:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788612850.916339:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788612850.916353:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788612850.916397:0:23493:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788612850.916430:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc9aee 00000100:00080000:1.0:1788612850.917208:0:23493:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788612850.917216:0:23493:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9612fe89b800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612850.917253:0:23493:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc76e680 x1875495932369792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788612850.917282:0:23493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788612850.917372:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932369792:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788612850.917426:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932369792 offset 0 length 520: 4 00000020:01000000:1.0:1788612850.917508:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612850.917514:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612850.917516:0:23493:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788612850.917519:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788612850.917521:0:23493:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788612850.917523:0:23493:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788612850.917525:0:23493:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788612850.917526:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788612850.917529:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612850.917530:0:23493:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788612850.917532:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788612850.917536:0:23493:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788612850.917539:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612850.917541:0:23493:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788612850.917543:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788612850.917547:0:23493:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:1.0:1788612850.917567:0:23493:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788612850.917582:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788612850.917597:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9611c69d19c0) 00000020:00000080:1.0:1788612850.917613:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788612850.917619:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788612850.917712:0:23493:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788612850.917720:0:23493:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788612850.917726:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1f8616bf0bc9afc 00010000:00080000:1.0:1788612850.917753:0:23493:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9612e0943800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1788612850.917964:0:23493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788612850.918032:0:23493:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788612850.918047:0:23493:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788612850.921996:0:23493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612850.922443:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788612850.922734:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1788612850.924019:0:23501:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788612850.924025:0:23501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000100:00080000:3.0:1788612850.924622:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612850.924627:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612850.924630:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612850.924633:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:3.0:1788612850.926719:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788612850.926734:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788612850.926774:0:23493:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788612850.926795:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc9b03 00000100:00080000:3.0:1788612850.926805:0:23493:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788612850.926812:0:23493:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9612e0943800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612850.926845:0:23493:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc716680 x1875495932369920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612850.926865:0:23493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788612850.926916:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612850.926921:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612850.926922:0:23493:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788612850.926925:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612850.926929:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612850.926931:0:23493:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788612850.926934:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788612850.926935:0:23493:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788612850.926937:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612850.926939:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612850.926940:0:23493:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788612850.926943:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612850.926945:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612850.926946:0:23493:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788612850.926950:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788612850.926973:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612850.926976:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612850.926977:0:23493:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788612850.926980:0:23493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:2.0:1788612850.927141:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788612850.927145:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788612850.927154:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788612850.927157:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788612850.927217:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932369920:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788612850.927269:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932369920 offset 0 length 520: 4 00000020:01000000:0.0:1788612850.927444:0:23489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788612850.927512:0:23489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788612850.927529:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc9a85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a8c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612850.927540:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c13d0200/0x1f8616bf0bc9a85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9a8c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612850.927548:0:23489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9611c6492800 from 1 10000000:01000000:0.0:1788612850.927551:0:23489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788612850.927578:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc9b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612850.927597:0:23489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc9b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612850.927609:0:23489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc9b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612850.927626:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932370048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788612850.927674:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612850.927693:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d1e6b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612850.927767:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932370048 00000100:00100000:2.0:1788612850.927774:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932370048 00000100:00100000:2.0:1788612850.927815:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788612850.927824:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+15:23489:x1875495932370048:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612850.927837:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612850.927849:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612f7b37800/0x1f8616bf0bc9b11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9b0a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612850.927870:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612f7b37800/0x1f8616bf0bc9b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b0a expref: 16 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612850.927881:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612f7b37800/0x1f8616bf0bc9b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b0a expref: 16 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612850.927889:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b37800, rc 0) 00000100:00100000:2.0:1788612850.927935:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+16:23489:x1875495932370048:12345-0@lo:101:mount.lustre.0 Request processed in 112us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612850.927943:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788612850.928074:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932370048:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612850.928088:0:23489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc9b0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b11 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612850.928098:0:23489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc9b0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9b11 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612850.928688:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932370176:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788612850.928743:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612850.928770:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c3747000 going to sleep for 11 seconds 00000100:00100000:2.0:1788612850.928895:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932370176 00000100:00100000:2.0:1788612850.928901:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932370176 00000100:00100000:2.0:1788612850.928931:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788612850.928939:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+16:23489:x1875495932370176:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788612850.928954:0:22751:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788612850.928970:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788612850.928973:0:22751:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788612850.929052:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+16:23489:x1875495932370176:12345-0@lo:256:mount.lustre.0 Request processed in 113us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612850.929064:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788612850.929108:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932370176:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788612850.930388:0:23489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788612850.930451:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc9b0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b11 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612850.930462:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc9b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b11 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612850.930496:0:23489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9611c6492800 from 1 10000000:01000000:2.0:1788612850.930499:0:23489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788612850.930533:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc9b18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612850.930540:0:23489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc9b18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612850.930550:0:23489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc9b18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612850.930570:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932370304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788612850.930621:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612850.930668:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0018e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612850.930929:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932370304 00000100:00100000:0.0:1788612850.930936:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932370304 00000100:00100000:0.0:1788612850.930988:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788612850.930998:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+16:23489:x1875495932370304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788612850.931009:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612850.931022:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a3e00/0x1f8616bf0bc9b1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9b18 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612850.931042:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a3e00/0x1f8616bf0bc9b1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b18 expref: 17 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612850.931053:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a3e00/0x1f8616bf0bc9b1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b18 expref: 17 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612850.931062:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3e00, rc 0) 00000100:00100000:0.0:1788612850.931101:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+17:23489:x1875495932370304:12345-0@lo:101:mount.lustre.0 Request processed in 105us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612850.931107:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788612850.931786:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932370304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612850.931804:0:23489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc9b18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b1f expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612850.931814:0:23489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc9b18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9b1f expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788612850.933172:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1788612850.933833:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612850.934052:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788612850.934078:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1788612850.934091:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1788612850.934102:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1788612850.934113:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1788612850.934125:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1788612850.934139:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1788612850.934151:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1788612850.934162:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788612850.934173:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1788612850.934185:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1788612850.934205:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1788612850.934210:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1788612850.934285:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932370432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612850.934348:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612850.934878:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0018a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612850.935269:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932370432 00000100:00100000:1.0:1788612850.935277:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932370432 00000100:00100000:1.0:1788612850.935332:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788612850.935353:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+17:23489:x1875495932370432:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612850.935558:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+17:23489:x1875495932370432:12345-0@lo:501:mount.lustre.0 Request processed in 206us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612850.935566:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788612850.935629:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932370432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612850.935676:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932370560:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612850.935723:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612850.935754:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0018a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788612850.935855:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932370560 00000100:00100000:1.0:1788612850.935859:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932370560 00000100:00100000:1.0:1788612850.935929:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788612850.935937:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+17:23489:x1875495932370560:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612850.936025:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+17:23489:x1875495932370560:12345-0@lo:503:mount.lustre.0 Request processed in 89us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612850.936032:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788612850.936104:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932370560:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788612850.936526:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788612850.936587:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932370688:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612850.936625:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612850.937344:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0018e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612850.937639:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932370688 00000100:00100000:0.0:1788612850.937645:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932370688 00000100:00100000:0.0:1788612850.937693:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788612850.937701:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+17:23489:x1875495932370688:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612850.937855:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+17:23489:x1875495932370688:12345-0@lo:502:mount.lustre.0 Request processed in 154us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612850.937863:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788612850.938055:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932370688:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788612850.938241:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788612850.938272:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1788612850.938305:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1788612850.938318:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1788612850.938331:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1788612850.938343:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1788612850.938354:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1788612850.938365:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1788612850.938377:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788612850.938390:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1788612850.938402:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1788612850.939117:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932370816:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612850.939177:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612850.939221:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0018e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788612850.939801:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932370816 00000100:00100000:3.0:1788612850.939809:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932370816 00000100:00100000:3.0:1788612850.939868:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788612850.939877:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+17:23489:x1875495932370816:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612850.940189:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+17:23489:x1875495932370816:12345-0@lo:502:mount.lustre.0 Request processed in 311us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612850.940206:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788612850.940293:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932370816:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788612850.940358:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1788612850.940370:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788612850.945993:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612850.946006:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612850.946008:0:23503:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788612850.946015:0:23503:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9611c6492800 00000020:00000080:3.0:1788612850.946018:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612850.946026:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612850.946029:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612850.946030:0:23503:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788612850.946032:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612850.946035:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612850.946036:0:23503:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788612850.946039:0:23503:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9611c6492800 00000020:00000080:3.0:1788612850.946041:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612850.946102:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612850.946106:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612850.946107:0:23503:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788612850.946110:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612850.946112:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612850.946113:0:23503:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788612850.946117:0:23503:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9611c6492800 00000020:00000080:3.0:1788612850.946119:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612850.946136:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612850.946138:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612850.946139:0:23503:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788612850.946141:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612850.946144:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612850.946145:0:23503:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788612850.946148:0:23503:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9611c6492800 00000020:00000080:3.0:1788612850.946150:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612850.946187:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612850.946191:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612850.946192:0:23503:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788612850.946271:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1788612850.946797:0:23489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788612850.946826:0:23489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788612850.946878:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc9b18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b1f expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612850.946890:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc9b18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b1f expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612850.947018:0:23489:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788612850.947021:0:23489:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9611c6492800 10000000:01000000:1.0:1788612850.947023:0:23489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9611c6492800 10000000:01000000:1.0:1788612850.947027:0:23489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788612850.947033:0:23489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9611c6492800 from 1 10000000:01000000:1.0:1788612850.947036:0:23489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788612850.947084:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d0a00/0x1f8616bf0bc9b26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612850.947091:0:23489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c13d0a00/0x1f8616bf0bc9b26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612850.947106:0:23489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c13d0a00/0x1f8616bf0bc9b26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612850.947131:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932370944:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788612850.947312:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612850.948048:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6936480 going to sleep for 11 seconds 00000100:00100000:2.0:1788612850.948650:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932370944 00000100:00100000:2.0:1788612850.948668:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932370944 00000100:00100000:2.0:1788612850.948725:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788612850.948734:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+17:23489:x1875495932370944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612850.948749:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612850.948765:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612f7b36800/0x1f8616bf0bc9b2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9b26 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612850.948791:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612f7b36800/0x1f8616bf0bc9b2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b26 expref: 18 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612850.948818:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612f7b36800/0x1f8616bf0bc9b2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b26 expref: 18 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612850.948827:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36800, rc 0) 00000100:00100000:2.0:1788612850.948879:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+18:23489:x1875495932370944:12345-0@lo:101:mount.lustre.0 Request processed in 146us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612850.948886:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788612850.949083:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932370944:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612850.949099:0:23489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c13d0a00/0x1f8616bf0bc9b26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b2d expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612850.949108:0:23489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c13d0a00/0x1f8616bf0bc9b26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9b2d expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788612850.952499:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1788612850.952784:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788612850.952986:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1788612850.953011:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1788612850.953027:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1788612850.953040:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1788612850.953054:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1788612850.953067:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1788612850.953078:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1788612850.953091:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1788612850.953103:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1788612850.953114:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1788612850.953125:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1788612850.953153:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1788612850.953170:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1788612850.953181:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1788612850.953386:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1788612850.953409:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1788612850.953427:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1788612850.953453:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1788612850.953540:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1788612850.953557:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1788612850.953572:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1788612850.953583:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1788612850.953595:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1788612850.953609:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1788612850.953624:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1788612850.953637:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1788612850.953669:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1788612850.953704:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1788612850.953720:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1788612850.953732:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1788612850.953743:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1788612850.953753:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1788612850.953764:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1788612850.953775:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1788612850.953790:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1788612850.953804:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1788612850.953817:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1788612850.953829:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1788612850.953842:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1788612850.953854:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1788612850.953867:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1788612850.953882:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1788612850.953896:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1788612850.953923:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1788612850.953938:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1788612850.953950:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1788612850.953964:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1788612850.953976:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1788612850.954089:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1788612850.954110:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1788612850.954128:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1788612850.954134:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1788612850.954679:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932371072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612850.954744:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612850.954823:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e09043c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612850.955341:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932371072 00000100:00100000:2.0:1788612850.955350:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932371072 00000100:00100000:2.0:1788612850.955403:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788612850.955413:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+18:23489:x1875495932371072:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612850.955783:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+18:23489:x1875495932371072:12345-0@lo:501:mount.lustre.0 Request processed in 371us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612850.955791:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788612850.962263:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932371072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612850.962353:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932371200:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612850.962603:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612850.962645:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e09043c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612850.964600:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932371200 00000100:00100000:2.0:1788612850.964614:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932371200 00000100:00100000:2.0:1788612850.965025:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788612850.965036:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+18:23489:x1875495932371200:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612850.965177:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+18:23489:x1875495932371200:12345-0@lo:503:mount.lustre.0 Request processed in 142us (2573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612850.965184:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788612850.968356:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932371200:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788612850.974779:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788612850.974876:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932371328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612850.974955:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612850.975010:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932371328 00000100:00100000:3.0:1788612850.975017:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932371328 00000100:00100000:3.0:1788612850.975057:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788612850.975065:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+18:23489:x1875495932371328:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612850.975160:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+18:23489:x1875495932371328:12345-0@lo:502:mount.lustre.0 Request processed in 94us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612850.975168:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788612850.975231:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e09043c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612850.975252:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932371328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788612850.975424:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1788612850.975453:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1788612850.976172:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1788612850.976211:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1788612850.976228:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1788612850.976257:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1788612850.976272:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1788612850.976283:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1788612850.976295:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1788612850.976306:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1788612850.976318:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1788612850.976329:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1788612850.976349:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1788612850.976360:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1788612850.976372:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1788612850.976383:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1788612850.976395:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1788612850.976406:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1788612850.976418:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1788612850.976441:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1788612850.976458:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1788612850.977008:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1788612850.977029:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1788612850.977043:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1788612850.977056:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1788612850.977068:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1788612850.977080:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1788612850.977092:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1788612850.977104:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1788612850.977117:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1788612850.977129:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1788612850.977141:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1788612850.977153:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1788612850.977165:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1788612850.977176:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1788612850.977188:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1788612850.977268:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1788612850.977293:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1788612850.977309:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1788612850.977321:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1788612850.977334:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1788612850.977346:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1788612850.977359:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1788612850.977371:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1788612850.977384:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1788612850.977406:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1788612850.977420:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1788612850.977606:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1788612850.977676:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932371456:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612850.977748:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612850.977827:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0dcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612850.978813:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932371456 00000100:00100000:2.0:1788612850.978823:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932371456 00000100:00100000:2.0:1788612850.978876:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788612850.978885:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+18:23489:x1875495932371456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612850.979024:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+18:23489:x1875495932371456:12345-0@lo:502:mount.lustre.0 Request processed in 138us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612850.979036:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788612850.979141:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932371456:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788612850.979332:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1788612850.979357:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1788612850.979383:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932371584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612850.979423:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612850.979460:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0dcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612850.979771:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932371584 00000100:00100000:2.0:1788612850.979776:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932371584 00000100:00100000:2.0:1788612850.979812:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788612850.979819:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+18:23489:x1875495932371584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612850.979893:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+18:23489:x1875495932371584:12345-0@lo:502:mount.lustre.0 Request processed in 74us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612850.979899:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788612850.979978:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932371584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788612850.980018:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1788612850.980028:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788612850.984022:0:23508:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788612850.984044:0:23508:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9611c5a219c0) 00000020:00000080:2.0:1788612850.984067:0:23508:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788612850.984144:0:23508:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9611c6492800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788612850.984148:0:23508:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9611c6492800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788612850.984151:0:23508:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9611c6492800 3 00010000:00080000:2.0:1788612850.984190:0:23508:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9612c909b800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1788612850.986734:0:23508:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788612850.990590:0:23508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788612850.990646:0:23508:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788612850.990670:0:23508:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x1f8616bf0bc9b3b 00000100:00080000:2.0:1788612850.990682:0:23508:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788612850.990689:0:23508:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9612c909b800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788612850.990723:0:23508:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fccc4000 x1875495932371712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788612850.990764:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875495932371712:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788612850.990831:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788612850.990883:0:23508:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788612850.990910:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788612850.990914:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788612850.990917:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788612850.990920:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788612850.995932:0:23508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000100:00100000:3.0:1788612851.006378:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932371712 00000100:00100000:3.0:1788612851.006393:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932371712 00000100:00100000:3.0:1788612851.006740:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788612851.006748:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932371712:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788612851.006775:0:22756:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:3.0:1788612851.006827:0:22756:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x1f8616bf0bc9b42 00000004:00100000:3.0:1788612851.006849:0:22756:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788612851.006881:0:22756:0:(import.c:65:import_set_state_nolock()) ffff9612e0944000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612851.007317:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875495932371712:12345-0@lo:38:llog_process_th.0 Request processed in 567us (16484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612851.007325:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788612851.007400:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9612fccc4000 x1875495932371712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:01000000:0.0:1788612851.007693:0:23489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788612851.007727:0:23489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788612851.007742:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d0a00/0x1f8616bf0bc9b26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b2d expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612851.007753:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c13d0a00/0x1f8616bf0bc9b26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b2d expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788612851.007797:0:23489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788612851.007798:0:23489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788612851.007800:0:23489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612851.007801:0:23489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612851.007802:0:23489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612851.007803:0:23489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612851.007804:0:23489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788612851.007805:0:23489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612851.007806:0:23489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788612851.007810:0:23489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1788612851.007812:0:23489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788612851.007813:0:23489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788612851.007814:0:23489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612851.007815:0:23489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612851.007816:0:23489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612851.007817:0:23489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612851.007818:0:23489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788612851.007819:0:23489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612851.007820:0:23489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788612851.007842:0:23489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788612851.007858:0:23489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932371840:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788612851.007896:0:23489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612851.007923:0:23489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d043ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612851.008001:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788612851.008012:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788612851.008020:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788612851.008025:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788612851.008027:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612c909b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788612851.008033:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875495932371712:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788612851.008064:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932371840 00000100:00100000:3.0:1788612851.008068:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932371840 00000100:00100000:3.0:1788612851.008116:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788612851.008124:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+18:23489:x1875495932371840:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788612851.008145:0:22748:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788612851.008157:0:22748:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788612851.015316:0:22736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788612851.021131:0:22748:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788612851.021156:0:22748:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788612851.021318:0:22772:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788612851.021324:0:22772:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788612851.021345:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc9b49 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612851.021363:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9a46 expref: 18 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612851.021370:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612f7b37800/0x1f8616bf0bc9b11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b0a expref: 18 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612851.021378:0:22772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc9b49 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612851.021438:0:22772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612f7b37800/0x1f8616bf0bc9b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9b0a expref: 18 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612851.021453:0:22772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612f7b37800/0x1f8616bf0bc9b11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b0a expref: 18 pid: 22748 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612851.021471:0:22772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbfb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1875495932371968:0@lo:104: 00000100:00100000:0.0:1788612851.021781:0:22772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612851.021832:0:22772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9a46 expref: 18 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612851.021842:0:22772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9a46 expref: 18 pid: 22748 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612851.021860:0:22772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbf100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1875495932372096:0@lo:104: 00000100:00100000:0.0:1788612851.021881:0:22772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612851.021897:0:22772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d043e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788612851.022232:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+18:23489:x1875495932371840:12345-0@lo:253:mount.lustre.0 Request processed in 14106us (14332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612851.022241:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932371968 00000100:00100000:3.0:1788612851.022244:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788612851.022248:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932371968 00000100:00100000:1.0:1788612851.022272:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932372096 00000100:00100000:1.0:1788612851.022275:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932372096 00000100:00100000:1.0:1788612851.022288:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612851.022295:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6b44f55-8b88-4406-a946-d178714afb91+4:22772:x1875495932371968:12345-0@lo:104: 00010000:00010000:1.0:1788612851.022306:0:22740:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc9b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9b11 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612851.022307:0:23489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:23489:1875495932371840:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788612851.022319:0:23489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788612851.022322:0:23489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788612851.022323:0:23489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788612851.022325:0:23489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612851.022326:0:23489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612851.022327:0:23489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612851.022329:0:23489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612851.022330:0:23489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788612851.022332:0:23489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612851.022339:0:23489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788612851.022351:0:23489:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788612851.022357:0:22740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788612851.022362:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6b44f55-8b88-4406-a946-d178714afb91+4:22772:x1875495932371968:12345-0@lo:104: Request processed in 68us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612851.022367:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612851.022380:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612851.022392:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6b44f55-8b88-4406-a946-d178714afb91+3:22772:x1875495932372096:12345-0@lo:104: 00010000:00010000:1.0:1788612851.022399:0:22740:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612e81dba00/0x1f8616bf0bc9a46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9a4d expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612851.022430:0:22740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788612851.022435:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6b44f55-8b88-4406-a946-d178714afb91+3:22772:x1875495932372096:12345-0@lo:104: Request processed in 44us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612851.022440:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788612851.023534:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612851.023544:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc9b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9b11 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612851.023552:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3800 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612851.023555:0:22745:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc9b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc9b11 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612851.023559:0:22772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbfb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1875495932371968:0@lo:104: 00010000:00010000:0.0:1788612851.023564:0:22745:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc9b0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc9b11 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612851.023568:0:22772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbf100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1875495932372096:0@lo:104: 10000000:00010000:0.0:1788612851.023572:0:22745:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc9b0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc9b11 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612851.023577:0:22745:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788612851.023587:0:22772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc9b49 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612851.023617:0:22745:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc9b0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9b11 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612851.023624:0:22745:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612851.023653:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc9b0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9b11 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612851.023670:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a3800/0x1f8616bf0bc9b0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9b11 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612851.023683:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612851.023695:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612e81dba00/0x1f8616bf0bc9a46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9a4d expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612851.023701:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612e81dba00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:0.0:1788612851.023704:0:22745:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612e81dba00/0x1f8616bf0bc9a46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc9a4d expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612851.023711:0:22745:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612e81dba00/0x1f8616bf0bc9a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc9a4d expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788612851.023716:0:22745:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612e81dba00/0x1f8616bf0bc9a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc9a4d expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612851.023719:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6b44f55-8b88-4406-a946-d178714afb91:3651:1875495932372224:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1788612851.023721:0:22745:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788612851.023735:0:22745:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612e81dba00/0x1f8616bf0bc9a46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9a4d expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612851.023740:0:22745:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788612851.023755:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612e81dba00/0x1f8616bf0bc9a46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9a4d expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612851.023760:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612851.023762:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612e81dba00/0x1f8616bf0bc9a46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9a4d expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612851.023776:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612851.023777:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612851.023779:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612851.023792:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932372224 00000100:00100000:0.0:1788612851.023797:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932372224 00010000:00010000:0.0:1788612851.023820:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612f7b37800/0x1f8616bf0bc9b11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b0a expref: 18 pid: 22748 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612851.023866:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612851.023874:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6b44f55-8b88-4406-a946-d178714afb91+18:3651:x1875495932372224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788612851.023886:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612851.023891:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612f7b37800/0x1f8616bf0bc9b11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b0a expref: 18 pid: 22748 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612851.023901:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612f7b37800/0x1f8616bf0bc9b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b0a expref: 18 pid: 22748 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612851.023925:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612f7b37800/0x1f8616bf0bc9b11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9b0a expref: 18 pid: 22748 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612851.023936:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612851.023970:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6b44f55-8b88-4406-a946-d178714afb91+17:3651:x1875495932372224:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612851.023977:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612851.024004:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6b44f55-8b88-4406-a946-d178714afb91:3651:1875495932372224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612851.026545:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6b44f55-8b88-4406-a946-d178714afb91:3648:1875495932372352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788612851.026614:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612851.026644:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932372352 00000100:00100000:2.0:1788612851.026652:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932372352 00010000:00010000:0.0:1788612851.026674:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612851.026695:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9a46 expref: 17 pid: 22748 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612851.026734:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788612851.026743:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b44f55-8b88-4406-a946-d178714afb91+17:3648:x1875495932372352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612851.026755:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612851.026761:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9a46 expref: 17 pid: 22748 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612851.026772:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9a46 expref: 17 pid: 22748 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612851.026787:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a3400/0x1f8616bf0bc9a4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9a46 expref: 17 pid: 22748 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612851.026801:0:22743:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc9b49 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612851.026810:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc9b49 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788612851.026825:0:22743:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005501093s 00010000:00010000:2.0:1788612851.026840:0:22743:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc9b49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612851.026846:0:22743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc9b49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612851.026853:0:22743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc9b49 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612851.026859:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc9b49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612851.026865:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2400 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612851.026869:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc9b49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612851.026878:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc9b49 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612851.026895:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc9b49 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612851.026905:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612851.026942:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b44f55-8b88-4406-a946-d178714afb91+16:3648:x1875495932372352:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612851.026949:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788612851.026974:0:22772:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc9b49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612851.026982:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc9b49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612851.026997:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a2400/0x1f8616bf0bc9b49 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612851.027030:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6b44f55-8b88-4406-a946-d178714afb91:3648:1875495932372352:0@lo:103:ldlm_bl.0 00000040:01000000:3.0:1788612851.036652:0:23489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788612851.036681:0:23515:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788612851.036685:0:23515:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788612851.038630:0:23516:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788612851.038817:0:23489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1788612851.040024:0:23516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788612851.045326:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788612851.045790:0:23516:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1788612851.054040:0:23517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23517:1875495932372480:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788612851.054111:0:23517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612851.054151:0:23517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d3552c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612851.054278:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932372480 00000100:00100000:0.0:1788612851.054286:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932372480 00000040:01000000:1.0:1788612851.054319:0:23489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:0.0:1788612851.054330:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788612851.054352:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23517:x1875495932372480:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788612851.054355:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788612851.054444:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23517:x1875495932372480:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 93us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612851.054451:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612851.054552:0:23517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23517:1875495932372480:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788612851.054576:0:23517:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788612851.054598:0:23517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23517:1875495932372608:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788612851.054624:0:23517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612851.054645:0:23517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d3552c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612851.054799:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932372608 00000100:00100000:0.0:1788612851.054803:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932372608 00000004:00000080:1.0:1788612851.054819:0:23489:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788612851.054824:0:23489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:0.0:1788612851.054824:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788612851.054830:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23517:x1875495932372608:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788612851.054860:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788612851.054922:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23517:x1875495932372608:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 92us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612851.054929:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788612851.054978:0:23517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23517:1875495932372608:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788612851.055018:0:23517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23517:1875495932372736:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788612851.055042:0:23517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612851.055062:0:23517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d35529c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612851.055290:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932372736 00000100:00100000:0.0:1788612851.055294:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932372736 00000100:00100000:0.0:1788612851.055318:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788612851.055323:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23517:x1875495932372736:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788612851.055366:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23517:x1875495932372736:12345-0@lo:900:lod0001_rec0000.0 Request processed in 43us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612851.055373:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788612851.055440:0:23517:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9612fc714e00 x1875495932372736/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788612867 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612851.055451:0:23517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23517:1875495932372736:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788612851.055511:0:23517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23517:1875495932372864:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788612851.055533:0:23517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612851.055547:0:23517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d3552c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612851.055686:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932372864 00000100:00100000:0.0:1788612851.055690:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932372864 00000100:00100000:0.0:1788612851.055710:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788612851.055716:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23517:x1875495932372864:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788612851.055767:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23517:x1875495932372864:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 50us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612851.055773:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:00080000:1.0:1788612851.055839:0:23489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1788612851.055878:0:23517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23517:1875495932372864:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788612851.055912:0:23517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612851.056465:0:23489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788612851.056521:0:23489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788612851.056622:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788612851.057078:0:23489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:3.0:1788612851.059704:0:23517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788612851.059791:0:23517:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788612851.059795:0:23517:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1788612851.069144:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788612851.071865:0:23489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1788612851.074228:0:23489:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788612851.074263:0:23489:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa9b94568f988 00100000:10000000:0.0:1788612851.074271:0:23489:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788612851.075209:0:23489:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788612851.075244:0:23489:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788612851.075261:0:23489:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788612851.075277:0:23489:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788612851.076022:0:23489:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788612851.076212:0:23489:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788612851.443957:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 0 seconds 00000040:00080000:2.0:1788612852.021563:0:23512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788612852.080102:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788612852.463572:0:22753:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788612852.463580:0:22753:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9611c6492800 from 12 10000000:01000000:3.0:1788612852.463585:0:22753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788612852.463630:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612e81daa00/0x1f8616bf0bc9b50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612852.463641:0:22753:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612e81daa00/0x1f8616bf0bc9b50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612852.463662:0:22753:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612e81daa00/0x1f8616bf0bc9b50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612852.463687:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932372992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788612852.463748:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612852.463798:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d35529c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612852.463858:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932372992 00000100:00100000:0.0:1788612852.463865:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932372992 00000100:00100000:0.0:1788612852.463922:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788612852.463930:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+16:22753:x1875495932372992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612852.463942:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612852.463955:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a2a00/0x1f8616bf0bc9b57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9b50 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612852.463977:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a2a00/0x1f8616bf0bc9b57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b50 expref: 17 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612852.463989:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a2a00/0x1f8616bf0bc9b57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b50 expref: 17 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612852.463997:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a2a00, rc 0) 00000100:00100000:0.0:1788612852.464050:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+17:22753:x1875495932372992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612852.464057:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788612852.464112:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932372992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612852.464125:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612e81daa00/0x1f8616bf0bc9b50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b57 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612852.464134:0:22753:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612e81daa00/0x1f8616bf0bc9b50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9b57 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612852.464182:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932373120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788612852.464213:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612852.464227:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea34480 going to sleep for 11 seconds 00000100:00100000:0.0:1788612852.464239:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932373120 00000100:00100000:0.0:1788612852.464243:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932373120 00000100:00100000:0.0:1788612852.464264:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788612852.464270:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+17:22753:x1875495932373120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788612852.464283:0:22748:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788612852.464298:0:22748:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788612852.464300:0:22748:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788612852.464366:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+17:22753:x1875495932373120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612852.464373:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788612852.464402:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932373120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788612852.464437:0:22753:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788612852.464444:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612e81daa00/0x1f8616bf0bc9b50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b57 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612852.464452:0:22753:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612e81daa00/0x1f8616bf0bc9b50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b57 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612852.464508:0:22753:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788612852.464510:0:22753:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9612e9172000 from 12 10000000:01000000:0.0:1788612852.464513:0:22753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788612852.464533:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc9b5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612852.464541:0:22753:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc9b5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612852.464548:0:22753:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc9b5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612852.464560:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932373248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612852.464583:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612852.464601:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea34480 going to sleep for 11 seconds 00000100:00100000:0.0:1788612852.464613:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 0 seconds 00000100:00100000:0.0:1788612852.464628:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932373248 00000100:00100000:0.0:1788612852.464631:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932373248 00000100:00100000:0.0:1788612852.464661:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788612852.464668:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+17:22753:x1875495932373248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612852.464674:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612852.464682:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc9b65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9b5e expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612852.464695:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc9b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b5e expref: 18 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612852.464703:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc9b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b5e expref: 18 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612852.464716:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a2200, rc 0) 00000100:00100000:0.0:1788612852.464741:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+18:22753:x1875495932373248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612852.464747:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788612852.464778:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932373248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612852.464788:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc9b5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b65 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612852.464795:0:22753:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc9b5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9b65 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612852.464827:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932373376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788612852.464852:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612852.464863:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea34480 going to sleep for 11 seconds 00000100:00100000:0.0:1788612852.464872:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932373376 00000100:00100000:0.0:1788612852.464874:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932373376 00000100:00100000:0.0:1788612852.464891:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788612852.464896:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c73ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+18:22753:x1875495932373376:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788612852.464905:0:22748:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788612852.464915:0:22748:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788612852.464917:0:22748:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788612852.464972:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c73ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+18:22753:x1875495932373376:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 75us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612852.464978:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788612852.465006:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932373376:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788612852.465046:0:22753:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788612852.465051:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc9b5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b65 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612852.465058:0:22753:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc9b5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b65 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788612853.041639:0:23512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788612853.103657:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612853.487679:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 0 seconds 00010000:00010000:0.0:1788612854.127875:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612854.513950:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 0 seconds 00010000:00010000:2.0:1788612855.151947:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788612855.167199:0:23759:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788612855.535987:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 0 seconds 00000020:00000004:1.0:1788612856.082797:0:23812:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788612856.083021:0:23812:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788612856.175692:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612856.303736:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612856.303760:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932373504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612856.303832:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612856.303897:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932373504 00000100:00100000:2.0:1788612856.303903:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932373504 00000100:00100000:2.0:1788612856.303943:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788612856.303952:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932373504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788612856.303997:0:22762:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788612856.304040:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932373504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612856.304048:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788612856.304092:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932373504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612856.308057:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1788612856.308077:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788612856.308082:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788612856.308086:0:36:0:(import.c:65:import_set_state_nolock()) ffff9612fccfc000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612856.308098:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9612fccfc000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612856.308121:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc714000 x1875495932373760/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612856.308139:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612856.308143:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612856.308145:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612856.308148:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788612856.308200:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788612856.308216:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932373888:0@lo:400:kworker.0 00000100:00100000:0.0:1788612856.308280:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612856.309645:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6b44f55-8b88-4406-a946-d178714afb91:3651:1875495932373632:0@lo:400:kworker.0 00000100:00100000:2.0:1788612856.309699:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612856.309757:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932373888 00000100:00100000:2.0:1788612856.309765:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932373888 00000100:00100000:2.0:1788612856.309817:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788612856.309825:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932373888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612856.309878:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932373888:12345-0@lo:400:kworker.0 Request processed in 53us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612856.309886:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788612856.309924:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9612fc715880 x1875495932373888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612856.309937:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932373888:0@lo:400:kworker.0 00000100:00100000:0.0:1788612856.309995:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932373632 00000100:00100000:0.0:1788612856.310000:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932373632 00000100:00100000:0.0:1788612856.310033:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788612856.310040:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c73efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+18:3651:x1875495932373632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612856.310075:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c73efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+18:3651:x1875495932373632:12345-0@lo:400:kworker.0 Request processed in 35us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612856.310081:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788612856.310152:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6b44f55-8b88-4406-a946-d178714afb91:3651:1875495932373632:0@lo:400:kworker.0 00000100:00100000:2.0:1788612856.310572:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932373760:0@lo:38:kworker.0 00000100:00100000:2.0:1788612856.310606:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612856.310712:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932373760 00000100:00100000:0.0:1788612856.310717:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932373760 00000100:00100000:0.0:1788612856.310745:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788612856.310750:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875495932373760:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788612856.310776:0:22761:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:0.0:1788612856.310811:0:22761:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc9b6c 00000004:00100000:0.0:1788612856.310826:0:22761:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788612856.310839:0:22761:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:3.0:1788612856.312447:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612856.312455:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612856.312458:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612856.312461:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788612856.312541:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612856.312557:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932374016:0@lo:400:kworker.0 00000100:00100000:3.0:1788612856.312662:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612856.312703:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932374016 00000100:00100000:3.0:1788612856.312709:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932374016 00000100:00100000:3.0:1788612856.312748:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788612856.312756:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932374016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612856.312801:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932374016:12345-0@lo:400:kworker.0 Request processed in 45us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612856.312808:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788612856.312843:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9612fc715f80 x1875495932374016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612856.312856:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932374016:0@lo:400:kworker.0 00000100:00080000:2.0:1788612856.326867:0:22761:0:(import.c:65:import_set_state_nolock()) ffff9612c9098000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788612856.326959:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875495932373760:12345-0@lo:38:kworker.0 Request processed in 16206us (16351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612856.326970:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788612856.327746:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788612856.327761:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788612856.327767:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788612856.327770:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612fccfc000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788612856.327794:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c44c43c1): req@ffff9612fc76f800 x1875495932366720/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612856.327813:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932373760:0@lo:38:kworker.0 00000100:00100000:0.0:1788612856.327887:0:22797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612856.327910:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fe8c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788612856.327926:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932366720 00000100:00100000:0.0:1788612856.327931:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932366720 00000100:00100000:0.0:1788612856.327965:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612856.327974:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22797:x1875495932366720:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788612856.328039:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22797:x1875495932366720:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 66us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612856.328046:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612856.328071:0:22797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76f800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22797:1875495932366720:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788612856.328101:0:22797:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788612856.328140:0:22797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbc700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22797:1875495932374144:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788612856.328169:0:22797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612856.328190:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcf266c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612856.329290:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932374144 00000100:00100000:2.0:1788612856.329299:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932374144 00000100:00100000:2.0:1788612856.329345:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788612856.329354:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22797:x1875495932374144:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788612856.329514:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22797:x1875495932374144:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 160us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612856.329522:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788612856.329556:0:22797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbc700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22797:1875495932374144:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788612856.329614:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932374272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612856.329651:0:22797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22797:1875495932374400:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788612856.329669:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612856.329697:0:22797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612856.329711:0:22797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d1f99300 going to sleep for 11 seconds 00000100:00100000:2.0:1788612856.329738:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932374272 00000100:00100000:2.0:1788612856.329742:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932374272 00000100:00100000:2.0:1788612856.329760:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932374400 00000100:00100000:2.0:1788612856.329762:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932374400 00000100:00100000:2.0:1788612856.329773:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788612856.329778:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3649:x1875495932374272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788612856.329799:0:22762:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788612856.329847:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3649:x1875495932374272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612856.329854:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788612856.329866:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788612856.329872:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22797:x1875495932374400:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788612856.329918:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22797:x1875495932374400:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 45us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612856.329926:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788612856.329956:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932374272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612856.329975:0:22797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22797:1875495932374400:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788612856.330018:0:22797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612856.332764:0:22797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788612856.332855:0:22797:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:2.0:1788612856.332861:0:22797:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1788612856.898016:0:23862:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788612856.898423:0:23862:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788612857.200720:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788612857.878532:0:23910:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeed0bd890 20000000:00000080:3.0:1788612857.878548:0:23910:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff961300e24c00 uarg=0000000000000000 20000000:01000000:3.0:1788612857.878585:0:23910:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788612857.878591:0:23910:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788612857.878602:0:23910:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788612857.879356:0:23911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788612857.881106:0:23910:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788612857.895236:0:23910:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788612857.895390:0:23910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9b73 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612857.895411:0:23910:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612f7b36c00/0x1f8616bf0bc9a1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9a15 expref: 17 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612857.895704:0:23910:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9611c67a3e00/0x1f8616bf0bc9b1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b18 expref: 17 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612857.895711:0:23910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9b73 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612857.895752:0:23910:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9611c67a3e00/0x1f8616bf0bc9b1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9b18 expref: 17 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612857.895766:0:23910:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9611c67a3e00/0x1f8616bf0bc9b1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b18 expref: 17 pid: 22751 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612857.895779:0:23910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc715f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23910:1875495932374528:0@lo:104: 00000100:00100000:3.0:1788612857.895902:0:23910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612857.895950:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932374528 00010000:00010000:3.0:1788612857.895957:0:23910:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612f7b36c00/0x1f8616bf0bc9a1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9a15 expref: 17 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612857.895957:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932374528 00010000:00010000:3.0:1788612857.895965:0:23910:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612f7b36c00/0x1f8616bf0bc9a1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9a15 expref: 17 pid: 22750 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612857.895973:0:23910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc717b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23910:1875495932374656:0@lo:104: 00000100:00100000:3.0:1788612857.895994:0:23910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612857.896065:0:23910:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0c8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612857.898819:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932374656 00000100:00100000:1.0:1788612857.898834:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932374656 00000100:00100000:1.0:1788612857.899176:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612857.899190:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc717800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6b44f55-8b88-4406-a946-d178714afb91+4:23910:x1875495932374528:12345-0@lo:104: 00010000:00010000:1.0:1788612857.899210:0:22739:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc9b18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9b1f expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.899382:0:22739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788612857.899389:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc717800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6b44f55-8b88-4406-a946-d178714afb91+4:23910:x1875495932374528:12345-0@lo:104: Request processed in 203us (3487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612857.899396:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612857.899417:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612857.899424:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6b44f55-8b88-4406-a946-d178714afb91+3:23910:x1875495932374656:12345-0@lo:104: 00010000:00010000:1.0:1788612857.899432:0:22739:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc9a15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9a1c expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.899466:0:22739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788612857.899471:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6b44f55-8b88-4406-a946-d178714afb91+3:23910:x1875495932374656:12345-0@lo:104: Request processed in 48us (3477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612857.899495:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788612857.899513:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612857.899535:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc9b18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9b1f expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.899561:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36600 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:1.0:1788612857.899566:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc9b18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc9b1f expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.899575:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc9b18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc9b1f expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612857.899583:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc9b18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc9b1f expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612857.899589:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788612857.899633:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc9b18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9b1f expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.899641:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612857.899660:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc9b18 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9b1f expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.899668:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612f7b36600/0x1f8616bf0bc9b18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9b1f expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.899680:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612857.899684:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc9a15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9a1c expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.899690:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2800 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:1.0:1788612857.899694:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc9a15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc9a1c expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.899711:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc9a15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc9a1c expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788612857.899718:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc9a15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc9a1c expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612857.899724:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788612857.899737:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc9a15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9a1c expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.899742:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788612857.899748:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc9a15 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9a1c expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.899755:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a2800/0x1f8616bf0bc9a15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9a1c expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.899768:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612857.899769:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612857.899771:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612857.899777:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612857.899799:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6b44f55-8b88-4406-a946-d178714afb91:3650:1875495932374784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788612857.899834:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612857.899873:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612857.899879:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6b44f55-8b88-4406-a946-d178714afb91:3650:1875495932374912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788612857.899915:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612857.899949:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932374784 00000100:00100000:1.0:1788612857.899954:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932374784 00010000:00010000:1.0:1788612857.899975:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9611c67a3e00/0x1f8616bf0bc9b1f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b18 expref: 18 pid: 22751 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612857.900015:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932374912 00000100:00100000:1.0:1788612857.900019:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932374912 00010000:00010000:1.0:1788612857.900037:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612f7b36c00/0x1f8616bf0bc9a1c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9a15 expref: 19 pid: 22750 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612857.900049:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612857.900055:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b44f55-8b88-4406-a946-d178714afb91+19:3650:x1875495932374784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788612857.900066:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612857.900071:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9611c67a3e00/0x1f8616bf0bc9b1f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b18 expref: 19 pid: 22751 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.900081:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9611c67a3e00/0x1f8616bf0bc9b1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b18 expref: 19 pid: 22751 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.900098:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612857.900125:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b44f55-8b88-4406-a946-d178714afb91+19:3650:x1875495932374784:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612857.900132:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612857.900145:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612857.900151:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b44f55-8b88-4406-a946-d178714afb91+18:3650:x1875495932374912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788612857.900158:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612857.900162:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612f7b36c00/0x1f8616bf0bc9a1c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9a15 expref: 18 pid: 22750 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.900170:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612f7b36c00/0x1f8616bf0bc9a1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9a15 expref: 18 pid: 22750 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.900181:0:22743:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9b73 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.900196:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9b73 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.900210:0:22743:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9b73 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.900217:0:22743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9b73 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.900224:0:22743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9b73 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.900231:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9b73 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.900237:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612e81dbe00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612857.900241:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9b73 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.900249:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9b73 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.900258:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9b73 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612857.900267:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612857.900291:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b44f55-8b88-4406-a946-d178714afb91+18:3650:x1875495932374912:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612857.900298:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612857.900335:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6b44f55-8b88-4406-a946-d178714afb91:3650:1875495932374912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788612857.900353:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6b44f55-8b88-4406-a946-d178714afb91:3650:1875495932374784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612857.902441:0:23910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a3e00/0x1f8616bf0bc9b1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9b18 expref: 17 pid: 22751 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612857.902693:0:23910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc715f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23910:1875495932374528:0@lo:104: 00010000:00010000:2.0:1788612857.902711:0:23910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612f7b36c00/0x1f8616bf0bc9a1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9a15 expref: 16 pid: 22750 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612857.902719:0:23910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc717b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23910:1875495932374656:0@lo:104: 00010000:00010000:2.0:1788612857.902744:0:23910:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9b73 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612857.902753:0:23910:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9b73 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612857.902760:0:23910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9b73 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612857.902765:0:23910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9b73 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612858.224449:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612859.251261:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788612859.439877:0:22753:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788612859.439884:0:22753:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9611c6492800 from 13 10000000:01000000:1.0:1788612859.439888:0:22753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788612859.439932:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc9b7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612859.439944:0:22753:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc9b7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612859.439955:0:22753:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc9b7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612859.439979:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932375040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788612859.440044:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612859.440086:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c80da540 going to sleep for 11 seconds 00000100:00100000:3.0:1788612859.440143:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932375040 00000100:00100000:3.0:1788612859.440151:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932375040 00000100:00100000:3.0:1788612859.440208:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788612859.440217:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c73edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+16:22753:x1875495932375040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612859.440229:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612859.440242:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612e81dbc00/0x1f8616bf0bc9b81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9b7a expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612859.440268:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612e81dbc00/0x1f8616bf0bc9b81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b7a expref: 17 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612859.440278:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612e81dbc00/0x1f8616bf0bc9b81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b7a expref: 17 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612859.440286:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612e81dbc00, rc 0) 00000100:00100000:3.0:1788612859.440372:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c73edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+17:22753:x1875495932375040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612859.440378:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788612859.443851:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932375040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612859.443881:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc9b7a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b81 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612859.443894:0:22753:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc9b7a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9b81 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612859.444895:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932375168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788612859.444958:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612859.445031:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c1377b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788612859.446962:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932375168 00000100:00100000:2.0:1788612859.446974:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932375168 00000100:00100000:2.0:1788612859.447022:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788612859.447031:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c73ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+17:22753:x1875495932375168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612859.447246:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c73ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+17:22753:x1875495932375168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (2288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612859.447254:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788612859.450887:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932375168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612859.450950:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932375296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612859.451021:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612859.451072:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c80dac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612859.452590:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932375296 00000100:00100000:2.0:1788612859.452610:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932375296 00000100:00100000:2.0:1788612859.452664:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788612859.452673:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c73ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+17:22753:x1875495932375296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612859.452809:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c73ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+17:22753:x1875495932375296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612859.452816:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788612859.453385:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932375296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788612859.454297:0:23986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788612859.455838:0:22753:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788612859.455873:0:22753:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788612859.455885:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc9b7a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b81 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612859.455896:0:22753:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc9b7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b81 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612859.455906:0:22753:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788612859.455909:0:22753:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612e9172000 from 13 10000000:01000000:2.0:1788612859.455911:0:22753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788612859.455950:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9b88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612859.455958:0:22753:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9b88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612859.455968:0:22753:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9b88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612859.456006:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932375424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612859.456065:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612859.456110:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c67ec240 going to sleep for 11 seconds 00000100:00100000:0.0:1788612859.456916:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932375424 00000100:00100000:0.0:1788612859.456925:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932375424 00000100:00100000:0.0:1788612859.457075:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788612859.457086:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c73ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+17:22753:x1875495932375424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612859.457100:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612859.457114:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc9b8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9b88 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612859.457139:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc9b8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b88 expref: 18 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612859.457150:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc9b8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b88 expref: 18 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612859.457159:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3a00, rc 0) 00000100:00100000:0.0:1788612859.457218:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c73ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+18:22753:x1875495932375424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612859.457225:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788612859.458757:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932375424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612859.458782:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9b88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b8f expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612859.458801:0:22753:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9b88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9b8f expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612859.458883:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932375552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612859.458933:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612859.458973:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c80da000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612859.459162:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932375552 00000100:00100000:3.0:1788612859.459169:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932375552 00000100:00100000:3.0:1788612859.459214:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788612859.459223:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c73ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+18:22753:x1875495932375552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612859.459325:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c73ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+18:22753:x1875495932375552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612859.459331:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788612859.460050:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932375552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612859.460089:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932375680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612859.460135:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612859.460162:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c80da000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612859.460204:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932375680 00000100:00100000:3.0:1788612859.460209:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932375680 00000100:00100000:3.0:1788612859.460276:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788612859.460283:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c73ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+18:22753:x1875495932375680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612859.460368:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c73ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+18:22753:x1875495932375680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612859.460375:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788612859.460732:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932375680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788612859.465027:0:23987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788612859.465668:0:22753:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788612859.465690:0:22753:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788612859.465701:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9b88 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b8f expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612859.465986:0:22753:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9b88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9b8f expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612860.272611:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612860.399618:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612850/real 1788612850] req@ffff9612fc716680 x1875495932369920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612860 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612860.399649:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9612fc716680 x1875495932369920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612860 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612860.399660:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612850/real 1788612850] req@ffff9612fc76e680 x1875495932369792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612860 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612860.399671:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9612fc76e680 x1875495932369792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612860 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788612860.399691:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612e0943800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612860.399725:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788612860.399729:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932369920:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788612860.399734:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612fe89b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612860.399740:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788612860.399743:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932369792:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788612860.399870:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612860.399874:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612860.399877:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612860.399880:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612860.399902:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612860.399905:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788612860.399908:0:8:0:(import.c:65:import_set_state_nolock()) ffff9612fe89b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612860.399913:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 665 00000100:00080000:3.0:1788612860.399918:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788612860.399924:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9612fe89b800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612860.399941:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc715180 x1875495932376320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612860.399953:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612860.399955:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788612860.399957:0:8:0:(import.c:65:import_set_state_nolock()) ffff9612e0943800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612860.399959:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 665 00000100:00080000:3.0:1788612860.399962:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788612860.399965:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9612e0943800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612860.399975:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc715880 x1875495932376448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788612860.400080:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932375936:0@lo:400:kworker.0 00000100:00100000:2.0:1788612860.400141:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612860.400170:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788612860.400176:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6b44f55-8b88-4406-a946-d178714afb91:3649:1875495932375808:0@lo:400:kworker.0 00000100:00100000:2.0:1788612860.400200:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612860.400236:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932375936 00000100:00100000:2.0:1788612860.400244:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932375936 00000100:00100000:2.0:1788612860.400282:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788612860.400290:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875495932375936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612860.400336:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875495932375936:12345-0@lo:400:kworker.0 Request processed in 47us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612860.400343:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788612860.400363:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932375808 00000100:00100000:2.0:1788612860.400366:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932375808 00000100:00100000:2.0:1788612860.400388:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788612860.400414:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c73ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+18:3649:x1875495932375808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612860.400445:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c73ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+18:3649:x1875495932375808:12345-0@lo:400:kworker.0 Request processed in 45us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612860.400452:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788612860.400511:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6b44f55-8b88-4406-a946-d178714afb91:3649:1875495932375808:0@lo:400:kworker.0 00000100:00100000:2.0:1788612860.400523:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932375936:0@lo:400:kworker.0 00000100:00100000:3.0:1788612860.400649:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932376064:0@lo:400:kworker.0 00000100:00100000:3.0:1788612860.400679:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612860.400700:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612860.400706:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932376192:0@lo:400:kworker.0 00000100:00100000:3.0:1788612860.400726:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612860.400754:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932376064 00000100:00100000:3.0:1788612860.400758:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932376064 00000100:00100000:3.0:1788612860.400786:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612860.400793:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932376064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612860.400827:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932376064:12345-0@lo:400:kworker.0 Request processed in 34us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612860.400832:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612860.400853:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932376192 00000100:00100000:3.0:1788612860.400857:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932376192 00000100:00100000:3.0:1788612860.400880:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788612860.400886:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932376192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612860.400914:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932376192:12345-0@lo:400:kworker.0 Request processed in 28us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612860.400920:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788612860.400947:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932376192:0@lo:400:kworker.0 00010000:00080000:3.0:1788612860.400957:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9612fc715f80 x1875495932376064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612860.400965:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932376064:0@lo:400:kworker.0 00000100:00100000:3.0:1788612860.400980:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612860.401112:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932376320:0@lo:8:kworker.0 00000400:00000100:0.0:1788612860.401136:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932376320 offset 0 length 520: 4 00000100:00100000:0.0:1788612860.401155:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932376448:0@lo:8:kworker.0 00000400:00000100:0.0:1788612860.401173:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932376448 offset 0 length 520: 4 00000100:00100000:3.0:1788612860.401855:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932376576:0@lo:400:kworker.0 00000100:00100000:3.0:1788612860.401892:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612860.402355:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932376576 00000100:00100000:2.0:1788612860.402362:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932376576 00000100:00100000:2.0:1788612860.402408:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788612860.402417:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932376576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612860.402492:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932376576:12345-0@lo:400:kworker.0 Request processed in 59us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612860.402498:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788612860.402667:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9612fc714e00 x1875495932376576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612860.402679:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932376576:0@lo:400:kworker.0 00000040:00080000:3.0:1788612860.656305:0:22790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788612861.301994:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612861.426534:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788612861.426558:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932376704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612861.426639:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612861.426894:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932376704 00000100:00100000:3.0:1788612861.426902:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932376704 00000100:00100000:3.0:1788612861.426960:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788612861.426969:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875495932376704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788612861.427002:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788612861.427062:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875495932376704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612861.427242:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932376704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612861.427521:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932376832:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612861.427555:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612861.427816:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932376832 00000100:00100000:1.0:1788612861.427823:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932376832 00000100:00100000:1.0:1788612861.427863:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788612861.427872:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932376832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788612861.427896:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788612861.427941:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932376832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612861.427948:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788612861.427982:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932376832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788612861.432626:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1788612862.322135:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788612862.451111:0:23490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:3.0:1788612863.283805:0:23512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788612863.343656:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612863.472899:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612848/real 1788612848] req@ffff9612fc715500 x1875495932367744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612863 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612863.472929:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9612fc715500 x1875495932367744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612863 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612863.472939:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612848/real 1788612848] req@ffff9612fc716d80 x1875495932367872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612863 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612863.472950:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9612fc716d80 x1875495932367872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612863 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788612863.472980:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c80c2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788612863.473013:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788612863.473018:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932367744:0@lo:8:kworker.0 00000100:00080000:3.0:1788612863.473023:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612c82bb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788612863.473028:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788612863.473031:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932367872:0@lo:8:kworker.0 00000100:00080000:1.0:1788612863.473318:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612863.473327:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788612863.473330:0:36:0:(import.c:65:import_set_state_nolock()) ffff9611c80c2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612863.473335:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 663 00000100:00080000:1.0:1788612863.473340:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788612863.473345:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9611c80c2800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612863.473366:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc76f480 x1875495932377216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788612863.473391:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612863.473395:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788612863.473397:0:36:0:(import.c:65:import_set_state_nolock()) ffff9612c82bb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788612863.473400:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 663 00000100:00080000:1.0:1788612863.473403:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788612863.473406:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9612c82bb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788612863.473417:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc76e680 x1875495932377344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788612863.473437:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612863.473440:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788612863.473443:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788612863.473446:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788612863.473507:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932377600:0@lo:400:kworker.0 00000100:00100000:0.0:1788612863.473515:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6b44f55-8b88-4406-a946-d178714afb91:3651:1875495932376960:0@lo:400:kworker.0 00000100:00100000:3.0:1788612863.473597:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932377216:0@lo:8:kworker.0 00000100:00100000:0.0:1788612863.475282:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612863.475366:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932377728:0@lo:400:kworker.0 00000100:00100000:0.0:1788612863.475417:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612863.476473:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612863.476535:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932377088:0@lo:400:kworker.0 00000100:00100000:0.0:1788612863.476563:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932377600 00000100:00100000:1.0:1788612863.476582:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612863.476582:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932377600 00000100:00100000:1.0:1788612863.476620:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788612863.476628:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932377472:0@lo:400:kworker.0 00000100:00100000:0.0:1788612863.476633:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932377088 00000100:00100000:0.0:1788612863.476638:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932377088 00000100:00100000:0.0:1788612863.476663:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788612863.476666:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612863.476675:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932377600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612863.476707:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788612863.476718:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932377088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612863.476738:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932377600:12345-0@lo:400:kworker.0 Request processed in 64us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612863.476748:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788612863.476772:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932377088:12345-0@lo:400:kworker.0 Request processed in 55us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612863.476781:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788612863.476811:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932377728 00000100:00100000:1.0:1788612863.476816:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932377728 00000100:00100000:1.0:1788612863.476848:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932377472 00000100:00100000:1.0:1788612863.476851:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932377472 00000100:00100000:3.0:1788612863.476865:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612863.476875:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932377728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612863.476881:0:22757:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788612863.476890:0:22757:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788612863.476910:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788612863.476924:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788612863.476925:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932377728:12345-0@lo:400:kworker.0 Request processed in 49us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612863.476936:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788612863.476936:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932377472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612863.476975:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932377472:12345-0@lo:400:kworker.0 Request processed in 43us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612863.476982:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788612863.477065:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932377600:0@lo:400:kworker.0 00010000:00080000:1.0:1788612863.477102:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9612fc76ed80 x1875495932377472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612863.477112:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932377472:0@lo:400:kworker.0 00000100:00100000:2.0:1788612863.477129:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932376960 00000100:00100000:2.0:1788612863.477135:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932376960 00000100:00100000:1.0:1788612863.477140:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932377088:0@lo:400:kworker.0 00000100:00100000:2.0:1788612863.477171:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788612863.477180:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c13ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+18:3651:x1875495932376960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612863.477220:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c13ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+18:3651:x1875495932376960:12345-0@lo:400:kworker.0 Request processed in 42us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612863.477232:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788612863.477347:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6b44f55-8b88-4406-a946-d178714afb91:3651:1875495932376960:0@lo:400:kworker.0 00010000:00080000:3.0:1788612863.477361:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9612fc76f100 x1875495932377728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612863.477371:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932377728:0@lo:400:kworker.0 00000400:00000100:3.0:1788612863.477410:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932377216 offset 0 length 520: 4 00000100:00100000:3.0:1788612863.477435:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932377344:0@lo:8:kworker.0 00000400:00000100:3.0:1788612863.477457:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875495932377344 offset 0 length 520: 4 00000020:01000004:1.0:1788612863.848363:0:24259:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788612863.848372:0:24259:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788612863.848374:0:24259:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788612863.849582:0:24259:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9611c68fd800 00000020:01000004:1.0:1788612863.849598:0:24259:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788612863.849612:0:24259:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788612863.849625:0:24259:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9611c69d0000) 00000020:00000080:1.0:1788612863.849642:0:24259:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788612863.908028:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788612863.910163:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788612863.910519:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788612863.911051:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788612863.911333:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788612863.911860:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788612863.912121:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:0.0:1788612863.914467:0:24259:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788612863.914735:0:24259:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788612863.914759:0:24259:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788612863.914770:0:24259:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1f8616bf0bc9b9d 00000020:01000004:0.0:1788612863.914777:0:24259:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788612863.914807:0:24259:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788612863.914811:0:24259:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788612863.914816:0:24259:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788612863.914821:0:24259:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788612863.914833:0:24259:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9612fb85cd40) 00000020:00000080:0.0:1788612863.914844:0:24259:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788612863.917014:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788612863.921010:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788612863.921026:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788612863.922874:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788612863.923148:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788612863.926023:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788612863.926034:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788612863.928039:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612863.928239:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788612863.928246:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788612863.929435:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788612863.929446:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788612863.953037:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788612863.957004:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788612863.957014:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788612863.958625:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788612863.958638:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788612863.959985:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788612863.959996:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788612863.973656:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788612863.976765:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788612863.976776:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788612863.982013:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788612863.982029:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788612864.031334:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788612864.031732:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788612864.031739:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788612864.034219:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788612864.034232:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788612864.034820:0:24259:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788612864.034856:0:24259:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788612864.034861:0:24259:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788612864.063223:0:24259:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788612864.063260:0:24259:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788612864.063264:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788612864.063266:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788612864.063268:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788612864.063269:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788612864.063270:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788612864.063272:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788612864.063273:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788612864.063275:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788612864.063276:0:24259:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788612864.063280:0:24259:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788612864.063282:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788612864.063284:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788612864.063302:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788612864.063304:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788612864.063305:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788612864.063306:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788612864.063307:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788612864.063309:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788612864.063310:0:24259:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788612864.063335:0:24259:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788612864.063354:0:24259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932377856:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788612864.063421:0:24259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612864.063465:0:24259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d136bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612864.063530:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932377856 00000100:00100000:2.0:1788612864.063539:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932377856 00000100:00100000:2.0:1788612864.063611:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788612864.063620:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+18:24259:x1875495932377856:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788612864.063647:0:22748:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788612864.063651:0:22748:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788612864.063655:0:22748:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788612864.063966:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+18:24259:x1875495932377856:12345-0@lo:253:mount.lustre.0 Request processed in 346us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612864.063974:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788612864.064002:0:24259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932377856:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788612864.064015:0:24259:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788612864.064017:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788612864.064019:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788612864.064020:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788612864.064021:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788612864.064022:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788612864.064023:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788612864.064024:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788612864.064026:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788612864.064027:0:24259:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788612864.064045:0:24259:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9611c68fd800 from lustre-OST0000 10000000:01000000:1.0:1788612864.064071:0:24259:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788612864.064074:0:24259:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788612864.064154:0:24259:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9612d1e63380 local copy 00010000:00010000:1.0:1788612864.064164:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612e81dae00/0x1f8616bf0bc9958 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc995f expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612864.064251:0:24259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932377984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612864.064283:0:24259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612864.064449:0:24259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d136b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788612864.064572:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932377984 00000100:00100000:2.0:1788612864.064578:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932377984 00000100:00100000:2.0:1788612864.064646:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788612864.064655:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+18:24259:x1875495932377984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612864.064735:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+18:24259:x1875495932377984:12345-0@lo:501:mount.lustre.0 Request processed in 81us (451us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788612864.064743:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788612864.064777:0:24259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932377984:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788612864.064802:0:24259:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788612864.064819:0:24259:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788612864.064825:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612e81dae00/0x1f8616bf0bc9958 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc995f expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612864.064834:0:24259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612e81dae00/0x1f8616bf0bc9958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc995f expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612864.064861:0:24259:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9611c68fd800 10000000:01000000:1.0:1788612864.064866:0:24259:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788612864.064870:0:24259:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788612864.064873:0:24259:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788612864.064877:0:24259:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788612864.064879:0:24259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788612864.064900:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1a00/0x1f8616bf0bc9bab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612864.064908:0:24259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c13d1a00/0x1f8616bf0bc9bab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612864.064916:0:24259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c13d1a00/0x1f8616bf0bc9bab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612864.064928:0:24259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932378112:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788612864.064958:0:24259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612864.064992:0:24259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d136b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788612864.065242:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932378112 00000100:00100000:3.0:1788612864.065247:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932378112 00000100:00100000:3.0:1788612864.065286:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788612864.065304:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+18:24259:x1875495932378112:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612864.065321:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612864.065332:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612e81dba00/0x1f8616bf0bc9bb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9bab expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.065355:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612e81dba00/0x1f8616bf0bc9bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9bab expref: 19 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.065366:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612e81dba00/0x1f8616bf0bc9bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9bab expref: 19 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.065513:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612e81dba00, rc 0) 00000100:00100000:3.0:1788612864.065555:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+19:24259:x1875495932378112:12345-0@lo:101:mount.lustre.0 Request processed in 252us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612864.065561:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788612864.065672:0:24259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932378112:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612864.065685:0:24259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c13d1a00/0x1f8616bf0bc9bab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9bb2 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612864.065701:0:24259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c13d1a00/0x1f8616bf0bc9bab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9bb2 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788612864.066937:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1788612864.068671:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612864.074732:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788612864.074925:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788612864.074940:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788612864.074953:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788612864.074965:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788612864.074975:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788612864.074986:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788612864.074997:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788612864.075008:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788612864.075020:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788612864.075033:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1788612864.075045:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1788612864.075069:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1788612864.075434:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1788612864.075688:0:24259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932378240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612864.076173:0:24259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612864.076282:0:24259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6a04e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788612864.081550:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932378240 00000100:00100000:0.0:1788612864.081573:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932378240 00000100:00100000:0.0:1788612864.081645:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788612864.081655:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+19:24259:x1875495932378240:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612864.081890:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+19:24259:x1875495932378240:12345-0@lo:501:mount.lustre.0 Request processed in 235us (5716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612864.081898:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788612864.082037:0:24259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932378240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612864.082101:0:24259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc716d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932378368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612864.082160:0:24259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612864.082200:0:24259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0c8780 going to sleep for 11 seconds 00000100:00100000:2.0:1788612864.082533:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932378368 00000100:00100000:2.0:1788612864.082540:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932378368 00000100:00100000:2.0:1788612864.082580:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788612864.082588:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+19:24259:x1875495932378368:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612864.083390:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+19:24259:x1875495932378368:12345-0@lo:503:mount.lustre.0 Request processed in 800us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612864.083399:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788612864.083528:0:24259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc716d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932378368:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788612864.084219:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788612864.084640:0:24259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc716d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932378496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612864.084701:0:24259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612864.084734:0:24259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0c8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788612864.085690:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932378496 00000100:00100000:0.0:1788612864.085700:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932378496 00000100:00100000:0.0:1788612864.085752:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788612864.085766:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+19:24259:x1875495932378496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612864.086556:0:24259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc716d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932378496:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612864.086619:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+19:24259:x1875495932378496:12345-0@lo:502:mount.lustre.0 Request processed in 857us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612864.086628:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000040:00080000:3.0:1788612864.086935:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788612864.086967:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788612864.087252:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788612864.087269:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788612864.087283:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788612864.087296:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788612864.087309:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788612864.087324:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788612864.087338:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1788612864.087351:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1788612864.087365:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788612864.087379:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788612864.087416:0:24259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc716d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932378624:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612864.087467:0:24259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612864.087900:0:24259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0c8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788612864.091011:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932378624 00000100:00100000:0.0:1788612864.091025:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932378624 00000100:00100000:0.0:1788612864.091616:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788612864.091679:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+19:24259:x1875495932378624:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612864.091960:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+19:24259:x1875495932378624:12345-0@lo:502:mount.lustre.0 Request processed in 283us (4491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612864.095728:0:24259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc716d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932378624:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788612864.096054:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788612864.096068:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788612864.097411:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788612864.097422:0:24276:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788612864.097430:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612864.097432:0:24276:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788612864.097440:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788612864.097461:0:24276:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9612ea248000) 00000020:00000080:1.0:1788612864.097535:0:24276:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788612864.097544:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788612864.097669:0:24276:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9611c68fd800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788612864.097677:0:24276:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788612864.097683:0:24276:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1f8616bf0bc9bc0 00000100:00100000:0.0:1788612864.112168:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:1.0:1788612864.112982:0:24276:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788612864.113997:0:24276:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:2.0:1788612864.117152:0:24276:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1788612864.118984:0:24276:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788612864.118996:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612864.119002:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612864.119004:0:24276:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788612864.119008:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788612864.119010:0:24276:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1788612864.119012:0:24276:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788612864.119013:0:24276:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788612864.119014:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788612864.119017:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612864.119018:0:24276:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788612864.119020:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612864.119023:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612864.119024:0:24276:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788612864.119027:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788612864.119029:0:24276:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788612864.119031:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612864.119033:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612864.119034:0:24276:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788612864.119036:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612864.119039:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612864.119040:0:24276:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788612864.119043:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788612864.119068:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612864.119071:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612864.119072:0:24276:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788612864.119076:0:24276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1788612864.119230:0:24259:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788612864.119258:0:24259:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788612864.119284:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1a00/0x1f8616bf0bc9bab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9bb2 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612864.119297:0:24259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c13d1a00/0x1f8616bf0bc9bab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9bb2 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612864.119306:0:24259:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9611c68fd800 from 1 10000000:01000000:1.0:1788612864.119309:0:24259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788612864.119342:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d0e00/0x1f8616bf0bc9bc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612864.119360:0:24259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c13d0e00/0x1f8616bf0bc9bc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612864.119371:0:24259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c13d0e00/0x1f8616bf0bc9bc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612864.119408:0:24259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932378752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788612864.119515:0:24259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612864.119557:0:24259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d136b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788612864.119669:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932378752 00000100:00100000:0.0:1788612864.119676:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932378752 00000100:00100000:0.0:1788612864.119724:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788612864.119734:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+19:24259:x1875495932378752:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788612864.119747:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612864.119758:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc9bce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9bc7 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612864.119781:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc9bce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9bc7 expref: 20 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612864.119792:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc9bce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9bc7 expref: 20 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612864.119801:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a2c00, rc 0) 00000100:00100000:0.0:1788612864.119847:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+20:24259:x1875495932378752:12345-0@lo:101:mount.lustre.0 Request processed in 115us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612864.119863:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788612864.120036:0:24259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932378752:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612864.120050:0:24259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c13d0e00/0x1f8616bf0bc9bc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9bce expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612864.120060:0:24259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c13d0e00/0x1f8616bf0bc9bc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9bce expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788612864.121294:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788612864.121645:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788612864.121828:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788612864.121854:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788612864.122044:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788612864.122063:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788612864.122076:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788612864.122088:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788612864.122099:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788612864.122112:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788612864.122124:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788612864.122136:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1788612864.122148:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1788612864.122176:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1788612864.122181:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1788612864.122259:0:24259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932378880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612864.122319:0:24259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612864.122525:0:24259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c298d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788612864.130707:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932378880 00000100:00100000:0.0:1788612864.130723:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932378880 00000100:00100000:0.0:1788612864.130787:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788612864.130798:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+20:24259:x1875495932378880:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612864.132176:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+20:24259:x1875495932378880:12345-0@lo:501:mount.lustre.0 Request processed in 1373us (9850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612864.132188:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788612864.138765:0:24259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932378880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612864.138834:0:24259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932379008:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612864.139042:0:24259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612864.139116:0:24259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c298d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788612864.139171:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932379008 00000100:00100000:2.0:1788612864.139178:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932379008 00000100:00100000:2.0:1788612864.139252:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788612864.139261:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+20:24259:x1875495932379008:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612864.139424:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+20:24259:x1875495932379008:12345-0@lo:503:mount.lustre.0 Request processed in 163us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612864.139438:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788612864.139528:0:24259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932379008:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788612864.140122:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788612864.140197:0:24259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc716d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932379136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612864.140241:0:24259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612864.140326:0:24259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0c8780 going to sleep for 11 seconds 00000100:00100000:2.0:1788612864.140445:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932379136 00000100:00100000:2.0:1788612864.140451:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932379136 00000100:00100000:2.0:1788612864.140544:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788612864.140553:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+20:24259:x1875495932379136:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612864.140653:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+20:24259:x1875495932379136:12345-0@lo:502:mount.lustre.0 Request processed in 100us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612864.140661:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788612864.140743:0:24259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc716d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932379136:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788612864.140931:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788612864.140957:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788612864.140973:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788612864.140987:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788612864.141001:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788612864.141016:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788612864.141046:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788612864.141063:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788612864.141088:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788612864.141102:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788612864.141115:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788612864.141137:0:24259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc716d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932379264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612864.141172:0:24259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612864.141332:0:24259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0c8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788612864.141410:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932379264 00000100:00100000:1.0:1788612864.141415:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932379264 00000100:00100000:1.0:1788612864.141442:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788612864.141449:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+20:24259:x1875495932379264:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612864.141562:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+20:24259:x1875495932379264:12345-0@lo:502:mount.lustre.0 Request processed in 113us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612864.141580:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788612864.141671:0:24259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc716d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932379264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788612864.141713:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788612864.141722:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788612864.142354:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612864.142364:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612864.142366:0:24280:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788612864.142372:0:24280:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9611c68fd800 00000020:00000080:3.0:1788612864.142375:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612864.142382:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612864.142384:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612864.142386:0:24280:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788612864.142388:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612864.142391:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612864.142392:0:24280:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788612864.142395:0:24280:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9611c68fd800 00000020:00000080:3.0:1788612864.142397:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612864.142455:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612864.142459:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612864.142460:0:24280:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788612864.142462:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612864.142465:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612864.142466:0:24280:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788612864.142470:0:24280:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9611c68fd800 00000020:00000080:3.0:1788612864.142472:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612864.142516:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612864.142524:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612864.142526:0:24280:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788612864.142529:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788612864.142532:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612864.142533:0:24280:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788612864.142537:0:24280:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9611c68fd800 00000020:00000080:3.0:1788612864.142539:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788612864.142574:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788612864.142578:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788612864.142580:0:24280:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788612864.142583:0:24280:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1788612864.144652:0:24259:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788612864.144693:0:24259:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788612864.144713:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d0e00/0x1f8616bf0bc9bc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9bce expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612864.144726:0:24259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c13d0e00/0x1f8616bf0bc9bc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9bce expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612864.144790:0:24259:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788612864.144793:0:24259:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9611c68fd800 10000000:01000000:0.0:1788612864.144796:0:24259:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9611c68fd800 10000000:01000000:0.0:1788612864.144800:0:24259:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788612864.144805:0:24259:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9611c68fd800 from 1 10000000:01000000:0.0:1788612864.144807:0:24259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788612864.144840:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9bd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612864.144848:0:24259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9bd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612864.144860:0:24259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9bd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612864.144889:0:24259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932379392:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788612864.144950:0:24259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612864.144987:0:24259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c66aa840 going to sleep for 11 seconds 00000100:00100000:0.0:1788612864.149741:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932379392 00000100:00100000:0.0:1788612864.149756:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932379392 00000100:00100000:0.0:1788612864.149818:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788612864.149829:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+20:24259:x1875495932379392:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788612864.149846:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612864.149879:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9611c67a2600/0x1f8616bf0bc9bdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9bd5 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612864.149906:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9611c67a2600/0x1f8616bf0bc9bdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9bd5 expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612864.149917:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9611c67a2600/0x1f8616bf0bc9bdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9bd5 expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612864.149926:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a2600, rc 0) 00000100:00100000:0.0:1788612864.149994:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+21:24259:x1875495932379392:12345-0@lo:101:mount.lustre.0 Request processed in 167us (5043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612864.150001:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788612864.150062:0:24259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932379392:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788612864.150082:0:24259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9bd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9bdc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612864.150091:0:24259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9bd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9bdc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788612864.161004:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1788612864.161311:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788612864.161611:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788612864.161637:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788612864.161660:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788612864.161674:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788612864.161688:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788612864.161703:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788612864.161717:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788612864.161731:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788612864.161760:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788612864.161776:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788612864.161788:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788612864.161801:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788612864.161814:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788612864.161827:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788612864.161840:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788612864.161855:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788612864.161945:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788612864.161970:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788612864.161984:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788612864.161998:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788612864.162011:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788612864.162023:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788612864.162037:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788612864.162051:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788612864.162079:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1788612864.162094:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1788612864.162107:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1788612864.162118:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1788612864.162128:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1788612864.162152:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1788612864.162167:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1788612864.162180:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1788612864.162193:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1788612864.162207:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1788612864.162221:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1788612864.162235:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1788612864.162248:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1788612864.162262:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1788612864.162276:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1788612864.162289:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1788612864.162316:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1788612864.162332:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1788612864.162345:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1788612864.162356:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1788612864.162370:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1788612864.162383:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1788612864.162396:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1788612864.162410:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788612864.162549:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788612864.162580:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788612864.162599:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788612864.162604:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788612864.162699:0:24259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932379520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612864.162764:0:24259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612864.162808:0:24259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c6cb5180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612864.162838:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932379520 00000100:00100000:0.0:1788612864.162846:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932379520 00000100:00100000:0.0:1788612864.165402:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788612864.165422:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+21:24259:x1875495932379520:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612864.165629:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+21:24259:x1875495932379520:12345-0@lo:501:mount.lustre.0 Request processed in 214us (2864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612864.165644:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788612864.172796:0:24259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932379520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612864.172856:0:24259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932379648:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788612864.173010:0:24259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612864.173055:0:24259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c6cb5180 going to sleep for 11 seconds 00000100:00100000:2.0:1788612864.173128:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932379648 00000100:00100000:2.0:1788612864.173137:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932379648 00000100:00100000:2.0:1788612864.173194:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788612864.173204:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+21:24259:x1875495932379648:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612864.173314:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+21:24259:x1875495932379648:12345-0@lo:503:mount.lustre.0 Request processed in 111us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612864.173322:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788612864.174584:0:24259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932379648:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788612864.175102:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788612864.175192:0:24259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932379776:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612864.175258:0:24259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612864.175295:0:24259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c6cb59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612864.175318:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932379776 00000100:00100000:0.0:1788612864.175323:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932379776 00000100:00100000:0.0:1788612864.175375:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788612864.175384:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+21:24259:x1875495932379776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612864.175529:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+21:24259:x1875495932379776:12345-0@lo:502:mount.lustre.0 Request processed in 145us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612864.175537:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788612864.175596:0:24259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932379776:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788612864.175761:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788612864.175787:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788612864.175801:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788612864.175812:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788612864.175826:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788612864.175839:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788612864.175851:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788612864.175953:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788612864.175970:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788612864.175982:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788612864.175995:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788612864.176008:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788612864.176021:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788612864.176032:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788612864.176044:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788612864.176057:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788612864.176071:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788612864.176082:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788612864.176105:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788612864.176119:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788612864.176131:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788612864.176144:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788612864.176156:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788612864.176168:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788612864.176179:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788612864.176190:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788612864.176202:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788612864.176214:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788612864.176227:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788612864.176240:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788612864.176252:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788612864.176264:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788612864.176278:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788612864.176290:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788612864.176318:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788612864.176334:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788612864.176347:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788612864.176361:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788612864.176374:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788612864.176387:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788612864.176412:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788612864.176426:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788612864.176439:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788612864.176450:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788612864.176461:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788612864.176472:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788612864.176518:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788612864.176532:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788612864.176580:0:24259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932379904:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612864.176629:0:24259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612864.176663:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932379904 00000100:00100000:0.0:1788612864.176668:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932379904 00000100:00100000:0.0:1788612864.176702:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788612864.176708:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+21:24259:x1875495932379904:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612864.176783:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+21:24259:x1875495932379904:12345-0@lo:502:mount.lustre.0 Request processed in 74us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612864.176790:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788612864.176823:0:24259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c6cb59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612864.176838:0:24259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932379904:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788612864.177107:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788612864.177129:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788612864.177150:0:24259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932380032:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612864.177185:0:24259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612864.177210:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932380032 00000100:00100000:0.0:1788612864.177214:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932380032 00000100:00100000:0.0:1788612864.177231:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788612864.177238:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+21:24259:x1875495932380032:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788612864.177302:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+21:24259:x1875495932380032:12345-0@lo:502:mount.lustre.0 Request processed in 64us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612864.177309:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788612864.177336:0:24259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c6cb59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612864.177348:0:24259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932380032:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788612864.177385:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788612864.177392:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788612864.179706:0:24286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788612864.179724:0:24286:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9612c93e99c0) 00000020:00000080:3.0:1788612864.179748:0:24286:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788612864.179853:0:24286:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9611c68fd800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788612864.179858:0:24286:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9611c68fd800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788612864.179861:0:24286:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9611c68fd800 3 00010000:00080000:3.0:1788612864.179967:0:24286:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9611c8f1e000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1788612864.182817:0:24286:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788612864.184707:0:24286:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788612864.184755:0:24286:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788612864.184770:0:24286:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1f8616bf0bc9bea 00000100:00080000:3.0:1788612864.184782:0:24286:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788612864.184790:0:24286:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9611c8f1e000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612864.184827:0:24286:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fc716d80 x1875495932380160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612864.184858:0:24286:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788612864.185001:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612864.185006:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612864.185015:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612864.185019:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612864.185046:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612864.185050:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612864.185052:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612864.185055:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788612864.185089:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932380672:0@lo:400:kworker.0 00000100:00100000:3.0:1788612864.185151:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612864.185184:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612864.185190:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932380544:0@lo:400:kworker.0 00000100:00100000:3.0:1788612864.185215:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612864.185246:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932380672 00000100:00100000:3.0:1788612864.185253:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932380672 00000100:00100000:3.0:1788612864.185290:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788612864.185299:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932380672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612864.185349:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932380672:12345-0@lo:400:kworker.0 Request processed in 50us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612864.185356:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788612864.185379:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932380544 00000100:00100000:3.0:1788612864.185383:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932380544 00000100:00100000:3.0:1788612864.185408:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788612864.185414:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932380544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612864.185448:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932380544:12345-0@lo:400:kworker.0 Request processed in 34us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612864.185463:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788612864.185550:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932380544:0@lo:400:kworker.0 00000100:00100000:0.0:1788612864.185650:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932380160:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788612864.185685:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612864.186581:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932380416:0@lo:400:kworker.0 00000100:00100000:0.0:1788612864.186622:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612864.186646:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612864.186653:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932380288:0@lo:400:kworker.0 00000100:00100000:0.0:1788612864.186677:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788612864.187010:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9611c80edf80 x1875495932380672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612864.187027:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932380672:0@lo:400:kworker.0 00000020:01000004:0.0:1788612864.187680:0:24286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788612864.187697:0:24286:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9612fe9e8000) 00000020:00000080:0.0:1788612864.187720:0:24286:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1788612864.187810:0:24286:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9611c68fd800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788612864.187815:0:24286:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9611c68fd800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788612864.187817:0:24286:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9611c68fd800 3 00010000:00080000:0.0:1788612864.187846:0:24286:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9611c1c8b000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.130@tcp at head 00000100:00100000:1.0:1788612864.190180:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932380160 00000100:00100000:1.0:1788612864.190191:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932380160 00000100:00100000:1.0:1788612864.190230:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932380416 00000100:00100000:1.0:1788612864.190234:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932380416 00000100:00100000:1.0:1788612864.190264:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788612864.190274:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932380416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612864.190365:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932380416:12345-0@lo:400:kworker.0 Request processed in 93us (3742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612864.190373:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788612864.190390:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612864.190394:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932380160:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788612864.190424:0:22756:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:1.0:1788612864.190457:0:22756:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1f8616bf0bc9bf8 00000004:00100000:1.0:1788612864.190472:0:22756:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788612864.190530:0:22756:0:(import.c:65:import_set_state_nolock()) ffff9611c7814000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612864.190583:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875495932380160:12345-0@lo:38:llog_process_th.0 Request processed in 187us (4897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612864.190591:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612864.190621:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932380288 00000100:00100000:1.0:1788612864.190625:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932380288 00000100:00100000:1.0:1788612864.190651:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788612864.190657:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932380288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612864.190693:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932380288:12345-0@lo:400:kworker.0 Request processed in 36us (4015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612864.190700:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788612864.190740:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932380288:0@lo:400:kworker.0 00010000:00080000:1.0:1788612864.190756:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9612fc714000 x1875495932380416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612864.190767:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932380416:0@lo:400:kworker.0 00010000:00080000:1.0:1788612864.190820:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9612fc716d80 x1875495932380160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612864.190829:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788612864.190835:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788612864.190841:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788612864.190846:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788612864.190854:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c8f1e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788612864.190860:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875495932380160:0@lo:38:llog_process_th.0 00010000:00010000:0.0:1788612864.192344:0:24286:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1788612864.192529:0:24286:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788612864.192583:0:24286:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788612864.192595:0:24286:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x1f8616bf0bc9bff 00000100:00080000:0.0:1788612864.192604:0:24286:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788612864.192610:0:24286:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9611c1c8b000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612864.192649:0:24286:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612febbf480 x1875495932380800/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788612864.192676:0:24286:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1788612864.194429:0:24286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1788612864.195315:0:24259:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788612864.195356:0:24259:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788612864.195375:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9bd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9bdc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612864.195388:0:24259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a3600/0x1f8616bf0bc9bd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9bdc expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788612864.195439:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788612864.195441:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788612864.195442:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612864.195443:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612864.195444:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612864.195446:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612864.195447:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788612864.195449:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612864.195450:0:24259:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788612864.195454:0:24259:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788612864.195456:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788612864.195458:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788612864.195459:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612864.195460:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612864.195461:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612864.195463:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612864.195464:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788612864.195465:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612864.195466:0:24259:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788612864.195511:0:24259:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788612864.195533:0:24259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932380928:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788612864.195636:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875495932380800:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788612864.195692:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612864.195764:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932380800 00000100:00100000:1.0:1788612864.195772:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932380800 00000100:00100000:1.0:1788612864.195804:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612864.195811:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875495932380800:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788612864.195838:0:22756:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:1.0:1788612864.195884:0:22756:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x1f8616bf0bc9c06 00000004:00100000:1.0:1788612864.195898:0:22756:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788612864.195931:0:22756:0:(import.c:65:import_set_state_nolock()) ffff9611c7812800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612864.195977:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875495932380800:12345-0@lo:38:llog_process_th.0 Request processed in 164us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612864.195984:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788612864.196024:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9612febbf480 x1875495932380800/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612864.196034:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788612864.196042:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788612864.196050:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788612864.196054:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788612864.196056:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c1c8b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788612864.196062:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875495932380800:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788612864.197754:0:24259:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612864.197800:0:24259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c6cb56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612864.197940:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932380928 00000100:00100000:1.0:1788612864.197948:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932380928 00000100:00100000:1.0:1788612864.198006:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788612864.198015:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+21:24259:x1875495932380928:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788612864.198043:0:22750:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788612864.198057:0:22750:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:2.0:1788612864.198998:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788612864.199005:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788612864.199008:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788612864.199011:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788612864.199015:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788612864.199018:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788612864.199020:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788612864.199032:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 20000000:01000000:0.0:1788612864.205109:0:22750:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788612864.205133:0:22750:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788612864.205240:0:22772:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788612864.205246:0:22772:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788612864.205268:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c0d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.205287:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9611c67a2a00/0x1f8616bf0bc9b57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b50 expref: 21 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.205296:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc9b65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b5e expref: 21 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.205304:0:22772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c0d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.205344:0:22772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc9b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9b5e expref: 21 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.205358:0:22772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc9b65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b5e expref: 21 pid: 22748 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612864.205381:0:22772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80edf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1875495932381056:0@lo:104: 00000100:00100000:3.0:1788612864.205445:0:22772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788612864.205519:0:22772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9611c67a2a00/0x1f8616bf0bc9b57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9b50 expref: 21 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.205538:0:22772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9611c67a2a00/0x1f8616bf0bc9b57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b50 expref: 21 pid: 22750 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612864.205548:0:22772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1875495932381184:0@lo:104: 00000100:00100000:3.0:1788612864.205584:0:22772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612864.205603:0:22772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c370d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788612864.205628:0:22739:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788612864.205648:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932381056 00000100:00100000:3.0:1788612864.205655:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932381056 00000100:00100000:3.0:1788612864.205687:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932381184 00000100:00100000:3.0:1788612864.205690:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932381184 00000100:00100000:3.0:1788612864.205705:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612864.205713:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6b44f55-8b88-4406-a946-d178714afb91+4:22772:x1875495932381056:12345-0@lo:104: 00010000:00010000:3.0:1788612864.205726:0:22739:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc9b5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9b65 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.205792:0:22739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788612864.205798:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6b44f55-8b88-4406-a946-d178714afb91+4:22772:x1875495932381056:12345-0@lo:104: Request processed in 86us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612864.205805:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612864.205823:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612864.205829:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c792b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6b44f55-8b88-4406-a946-d178714afb91+3:22772:x1875495932381184:12345-0@lo:104: 00010000:00010000:3.0:1788612864.205837:0:22739:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612e81daa00/0x1f8616bf0bc9b50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9b57 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.205888:0:22739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788612864.205894:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c792b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6b44f55-8b88-4406-a946-d178714afb91+3:22772:x1875495932381184:12345-0@lo:104: Request processed in 66us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612864.205905:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788612864.205943:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612864.205949:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc9b5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9b65 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.205956:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2e00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612864.205960:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc9b5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc9b65 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.205968:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc9b5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc9b65 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612864.205975:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc9b5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc9b65 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612864.205980:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788612864.206005:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc9b5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9b65 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206011:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612864.206031:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc9b5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9b65 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206038:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a2e00/0x1f8616bf0bc9b5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9b65 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206048:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612864.206052:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612e81daa00/0x1f8616bf0bc9b50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9b57 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206066:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612e81daa00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612864.206069:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612e81daa00/0x1f8616bf0bc9b50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc9b57 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206075:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612e81daa00/0x1f8616bf0bc9b50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc9b57 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612864.206082:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612e81daa00/0x1f8616bf0bc9b50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc9b57 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612864.206086:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788612864.206098:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612e81daa00/0x1f8616bf0bc9b50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9b57 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206103:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612864.206108:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612e81daa00/0x1f8616bf0bc9b50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9b57 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206113:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612e81daa00/0x1f8616bf0bc9b50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9b57 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206124:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612864.206125:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612864.206127:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612864.206139:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6b44f55-8b88-4406-a946-d178714afb91:3648:1875495932381312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612864.206165:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612864.206185:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612864.206190:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6b44f55-8b88-4406-a946-d178714afb91:3648:1875495932381440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612864.206218:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612864.206249:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932381312 00000100:00100000:3.0:1788612864.206253:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932381312 00010000:00010000:3.0:1788612864.206268:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc9b65 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b5e expref: 22 pid: 22748 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612864.206286:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932381440 00000100:00100000:3.0:1788612864.206288:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932381440 00010000:00010000:3.0:1788612864.206296:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9611c67a2a00/0x1f8616bf0bc9b57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b50 expref: 23 pid: 22750 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612864.206308:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612864.206314:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6b44f55-8b88-4406-a946-d178714afb91+23:3648:x1875495932381312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612864.206323:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612864.206328:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc9b65 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b5e expref: 23 pid: 22748 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206338:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc9b65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b5e expref: 23 pid: 22748 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206351:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612864.206376:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6b44f55-8b88-4406-a946-d178714afb91+23:3648:x1875495932381312:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612864.206383:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612864.206396:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612864.206402:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e97ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6b44f55-8b88-4406-a946-d178714afb91+22:3648:x1875495932381440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612864.206409:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612864.206413:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9611c67a2a00/0x1f8616bf0bc9b57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b50 expref: 22 pid: 22750 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206432:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9611c67a2a00/0x1f8616bf0bc9b57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b50 expref: 22 pid: 22750 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206444:0:22741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c0d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206451:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c0d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788612864.206463:0:22741:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005501093s 00010000:00010000:3.0:1788612864.206467:0:22741:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c0d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206497:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c0d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206504:0:22741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c0d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206510:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c0d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206515:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612e81dbe00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612864.206519:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c0d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206526:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c0d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206534:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c0d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206552:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612864.206588:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e97ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6b44f55-8b88-4406-a946-d178714afb91+22:3648:x1875495932381440:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612864.206595:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612864.206648:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6b44f55-8b88-4406-a946-d178714afb91:3648:1875495932381440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612864.206657:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6b44f55-8b88-4406-a946-d178714afb91:3648:1875495932381312:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788612864.206684:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a2200/0x1f8616bf0bc9b65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9b5e expref: 21 pid: 22748 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612864.206692:0:22772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80edf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1875495932381056:0@lo:104: 00010000:00010000:3.0:1788612864.206700:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a2a00/0x1f8616bf0bc9b57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9b50 expref: 20 pid: 22750 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612864.206707:0:22772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1875495932381184:0@lo:104: 00010000:00010000:3.0:1788612864.206718:0:22772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c0d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206726:0:22772:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c0d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206732:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c0d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612864.206737:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c0d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612864.207145:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612864.207260:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+19:24259:x1875495932380928:12345-0@lo:253:mount.lustre.0 Request processed in 9245us (9510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612864.207274:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788612864.207353:0:24259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:24259:1875495932380928:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788612864.207364:0:24259:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788612864.207366:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788612864.207368:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788612864.207369:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788612864.207383:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788612864.207385:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788612864.207386:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788612864.207387:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788612864.207389:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788612864.207391:0:24259:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788612864.207403:0:24259:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1788612864.209810:0:24259:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788612864.214249:0:24259:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788612864.214259:0:24259:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788612864.214295:0:24259:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788612864.214338:0:24259:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788612864.214354:0:24259:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788612864.214372:0:24259:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788612864.215472:0:24259:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788612864.216275:0:24259:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788612864.369213:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788612865.054219:0:24338:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788612865.055956:0:24338:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788612865.391689:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788612865.782073:0:22753:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788612865.782081:0:22753:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9611c6492800 from 13 10000000:01000000:1.0:1788612865.782085:0:22753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788612865.782131:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc9c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612865.782142:0:22753:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc9c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612865.782153:0:22753:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc9c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612865.782178:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932381568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788612865.782630:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612865.782720:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c92f9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788612865.788518:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932381568 00000100:00100000:3.0:1788612865.788532:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932381568 00000100:00100000:3.0:1788612865.788605:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788612865.788615:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+19:22753:x1875495932381568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612865.788631:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612865.788650:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9c14 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612865.788676:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9c14 expref: 20 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612865.788687:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9c14 expref: 20 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612865.788695:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612e81dbe00, rc 0) 00000100:00100000:3.0:1788612865.788776:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+20:22753:x1875495932381568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (6147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612865.788782:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788612865.789075:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932381568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612865.789094:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc9c14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9c1b expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612865.789103:0:22753:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc9c14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9c1b expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612865.789172:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932381696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788612865.789457:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612865.790531:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcf26600 going to sleep for 11 seconds 00000100:00100000:0.0:1788612865.807359:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932381696 00000100:00100000:0.0:1788612865.807384:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932381696 00000100:00100000:0.0:1788612865.807454:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788612865.807464:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+20:22753:x1875495932381696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788612865.807506:0:22750:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788612865.807522:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788612865.807525:0:22750:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788612865.807656:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+20:22753:x1875495932381696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 193us (18198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612865.807663:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788612865.807731:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932381696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788612865.807798:0:22753:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788612865.807808:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc9c14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9c1b expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612865.807818:0:22753:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc9c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9c1b expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788612865.807828:0:22753:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788612865.807831:0:22753:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9612e9172000 from 13 10000000:01000000:0.0:1788612865.807833:0:22753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788612865.808189:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3e00/0x1f8616bf0bc9c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612865.808430:0:22753:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9611c67a3e00/0x1f8616bf0bc9c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612865.808440:0:22753:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9611c67a3e00/0x1f8616bf0bc9c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612865.808461:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932381824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612865.808526:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612865.808570:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c8284c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612865.808761:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932381824 00000100:00100000:2.0:1788612865.808767:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932381824 00000100:00100000:2.0:1788612865.808801:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788612865.808808:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+20:22753:x1875495932381824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612865.808818:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612865.808829:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc9c29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9c22 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612865.808861:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc9c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9c22 expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612865.808871:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc9c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9c22 expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612865.808878:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b37200, rc 0) 00000100:00100000:2.0:1788612865.808911:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+21:22753:x1875495932381824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612865.808917:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788612865.810318:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932381824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788612865.810341:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9611c67a3e00/0x1f8616bf0bc9c22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9c29 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612865.810351:0:22753:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9611c67a3e00/0x1f8616bf0bc9c22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9c29 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612865.810583:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932381952:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788612865.810636:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612865.810669:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c8284c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612865.811303:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932381952 00000100:00100000:2.0:1788612865.811311:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932381952 00000100:00100000:2.0:1788612865.811349:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788612865.811356:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+21:22753:x1875495932381952:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788612865.811381:0:22751:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788612865.811395:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788612865.811398:0:22751:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788612865.811514:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+21:22753:x1875495932381952:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 157us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612865.811522:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788612865.814466:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932381952:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788612865.814587:0:22753:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788612865.814598:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9611c67a3e00/0x1f8616bf0bc9c22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9c29 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612865.814610:0:22753:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9611c67a3e00/0x1f8616bf0bc9c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9c29 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612866.415753:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612866.543630:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612866.543651:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932382080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612866.543716:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612866.543768:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932382080 00000100:00100000:1.0:1788612866.543775:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932382080 00000100:00100000:1.0:1788612866.543819:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788612866.543828:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932382080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788612866.543862:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788612866.543918:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932382080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612866.543926:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788612866.543959:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932382080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788612866.544161:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932382208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788612866.544193:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612866.544223:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932382208 00000100:00100000:3.0:1788612866.544227:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932382208 00000100:00100000:3.0:1788612866.544258:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788612866.544267:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932382208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788612866.544291:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788612866.544335:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932382208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612866.544341:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788612866.544934:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932382208:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788612867.439729:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612868.467638:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612869.487803:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788612869.617796:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612869.617803:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612869.617806:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612869.617809:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612869.617850:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612869.617853:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612869.617856:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612869.617858:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788612869.617898:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932382592:0@lo:400:kworker.0 00000100:00100000:3.0:1788612869.617965:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612869.618015:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932383104:0@lo:400:kworker.0 00000100:00100000:3.0:1788612869.618043:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612869.618072:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612869.618079:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932382720:0@lo:400:kworker.0 00000100:00100000:3.0:1788612869.618106:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612869.618135:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932382592 00000100:00100000:3.0:1788612869.618142:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932382592 00000100:00100000:3.0:1788612869.618196:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932383104 00000100:00100000:3.0:1788612869.618199:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932383104 00000100:00100000:3.0:1788612869.618233:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788612869.618242:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932382592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612869.618292:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932382592:12345-0@lo:400:kworker.0 Request processed in 51us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612869.618300:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788612869.618317:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788612869.618324:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932383104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612869.618354:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932383104:12345-0@lo:400:kworker.0 Request processed in 30us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612869.618360:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788612869.618402:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c80ef480 x1875495932382592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612869.618423:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932382592:0@lo:400:kworker.0 00010000:00080000:3.0:1788612869.618435:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c80ef800 x1875495932383104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612869.618444:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932383104:0@lo:400:kworker.0 00000100:00100000:1.0:1788612869.618709:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932382464:0@lo:400:kworker.0 00000100:00100000:1.0:1788612869.618745:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612869.618780:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932382976:0@lo:400:kworker.0 00000100:00100000:1.0:1788612869.618802:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612869.618822:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788612869.618828:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6b44f55-8b88-4406-a946-d178714afb91:3649:1875495932382336:0@lo:400:kworker.0 00000100:00100000:1.0:1788612869.618855:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612869.618877:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932382848:0@lo:400:kworker.0 00000100:00100000:1.0:1788612869.618901:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612869.618928:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932382976 00000100:00100000:1.0:1788612869.618932:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932382976 00000100:00100000:1.0:1788612869.618953:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932382848 00000100:00100000:1.0:1788612869.618955:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932382848 00000100:00100000:1.0:1788612869.618969:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788612869.618975:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932382976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612869.619011:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932382976:12345-0@lo:400:kworker.0 Request processed in 36us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612869.619017:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788612869.619030:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612869.619036:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932382848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612869.619062:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875495932382848:12345-0@lo:400:kworker.0 Request processed in 27us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612869.619079:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612869.619103:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932382720 00000100:00100000:1.0:1788612869.619107:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932382720 00000100:00100000:1.0:1788612869.619128:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932382464 00000100:00100000:1.0:1788612869.619131:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932382464 00000100:00100000:1.0:1788612869.619141:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788612869.619147:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932382720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612869.619199:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932382720:12345-0@lo:400:kworker.0 Request processed in 52us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612869.619205:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788612869.619216:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788612869.619221:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932382464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612869.619245:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932382464:12345-0@lo:400:kworker.0 Request processed in 25us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612869.619250:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788612869.619274:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932382336 00000100:00100000:1.0:1788612869.619278:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932382336 00000100:00100000:1.0:1788612869.619300:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788612869.619305:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+21:3649:x1875495932382336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612869.619333:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+21:3649:x1875495932382336:12345-0@lo:400:kworker.0 Request processed in 27us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612869.619338:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788612869.619375:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932382720:0@lo:400:kworker.0 00000100:00100000:1.0:1788612869.619402:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6b44f55-8b88-4406-a946-d178714afb91:3649:1875495932382336:0@lo:400:kworker.0 00010000:00080000:1.0:1788612869.619412:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c80eca80 x1875495932382848/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612869.619428:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875495932382848:0@lo:400:kworker.0 00000100:00100000:1.0:1788612869.619440:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932382464:0@lo:400:kworker.0 00010000:00080000:1.0:1788612869.619448:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c80ece00 x1875495932382976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612869.619456:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932382976:0@lo:400:kworker.0 00000100:00080000:1.0:1788612869.619535:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788612869.619539:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788612870.511655:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788612870.897127:0:22790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1788612871.001876:0:24629:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788612871.535638:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612871.664267:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932383232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612871.664333:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612871.664471:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932383232 00000100:00100000:0.0:1788612871.664510:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932383232 00000100:00100000:0.0:1788612871.664564:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788612871.664574:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932383232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788612871.664607:0:22762:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788612871.664672:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932383232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612871.664679:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788612871.664878:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932383232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612871.686984:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932383360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612871.687058:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612871.687938:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932383360 00000100:00100000:0.0:1788612871.687947:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932383360 00000100:00100000:0.0:1788612871.687998:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788612871.688008:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932383360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788612871.688042:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788612871.688109:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932383360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612871.688116:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788612871.690074:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932383360:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1788612872.003310:0:24681:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788612872.003578:0:24681:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788612872.560871:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788612872.893172:0:24731:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788612872.893465:0:24731:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1788612873.520195:0:23512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788612873.584741:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612874.609653:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788612874.740390:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612874.740396:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612874.740399:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612874.740402:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612874.740417:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612874.740420:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788612874.740422:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612874.740424:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788612874.740522:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932383872:0@lo:400:kworker.0 00000100:00100000:0.0:1788612874.740589:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612874.740640:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788612874.740647:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6b44f55-8b88-4406-a946-d178714afb91:3648:1875495932383488:0@lo:400:kworker.0 00000100:00100000:0.0:1788612874.740673:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612874.740696:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932384000:0@lo:400:kworker.0 00000100:00100000:0.0:1788612874.740719:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612874.740747:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932383616:0@lo:400:kworker.0 00000100:00100000:0.0:1788612874.740770:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612874.740786:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932384128:0@lo:400:kworker.0 00000100:00100000:0.0:1788612874.740806:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612874.740822:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788612874.740827:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932383744:0@lo:400:kworker.0 00000100:00100000:0.0:1788612874.740848:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612874.740865:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fda19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932384256:0@lo:400:kworker.0 00000100:00100000:0.0:1788612874.740898:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612874.740930:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932383872 00000100:00100000:0.0:1788612874.740937:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932383872 00000100:00100000:0.0:1788612874.740976:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932383616 00000100:00100000:0.0:1788612874.740979:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932383616 00000100:00100000:0.0:1788612874.740996:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788612874.741004:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fda1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932383872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612874.741055:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fda1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932383872:12345-0@lo:400:kworker.0 Request processed in 51us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612874.741062:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788612874.741079:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788612874.741085:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fda1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932383616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612874.741115:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fda1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932383616:12345-0@lo:400:kworker.0 Request processed in 31us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612874.741121:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788612874.741137:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932383488 00000100:00100000:0.0:1788612874.741140:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932383488 00000100:00100000:0.0:1788612874.741163:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788612874.741169:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+21:3648:x1875495932383488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612874.741197:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+21:3648:x1875495932383488:12345-0@lo:400:kworker.0 Request processed in 28us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612874.741204:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788612874.741229:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932384000 00000100:00100000:0.0:1788612874.741233:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932384000 00000100:00100000:0.0:1788612874.741250:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932384128 00000100:00100000:0.0:1788612874.741253:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932384128 00000100:00100000:0.0:1788612874.741274:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932383744 00000100:00100000:0.0:1788612874.741277:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932383744 00000100:00100000:0.0:1788612874.741299:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932384256 00000100:00100000:0.0:1788612874.741301:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932384256 00000100:00100000:0.0:1788612874.741337:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788612874.741344:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fda1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932384000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612874.741377:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fda1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932384000:12345-0@lo:400:kworker.0 Request processed in 33us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612874.741383:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788612874.741395:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788612874.741401:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fda18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932384128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612874.741425:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fda18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932384128:12345-0@lo:400:kworker.0 Request processed in 25us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612874.741431:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788612874.741441:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788612874.741447:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fda18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932383744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612874.741473:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fda18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932383744:12345-0@lo:400:kworker.0 Request processed in 26us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612874.741513:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788612874.741524:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788612874.741529:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fda18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932384256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612874.741569:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fda18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932384256:12345-0@lo:400:kworker.0 Request processed in 39us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612874.741577:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788612874.741620:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6b44f55-8b88-4406-a946-d178714afb91:3648:1875495932383488:0@lo:400:kworker.0 00010000:00080000:0.0:1788612874.741634:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612febbf480 x1875495932384000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612874.741657:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932384000:0@lo:400:kworker.0 00000100:00100000:0.0:1788612874.741669:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932383872:0@lo:400:kworker.0 00010000:00080000:0.0:1788612874.741701:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612febbd180 x1875495932383744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612874.741709:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932383744:0@lo:400:kworker.0 00010000:00080000:0.0:1788612874.741718:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fda19c00 x1875495932384256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612874.741726:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fda19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932384256:0@lo:400:kworker.0 00000100:00100000:0.0:1788612874.741735:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932383616:0@lo:400:kworker.0 00010000:00080000:0.0:1788612874.741744:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612febbea00 x1875495932384128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612874.741751:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932384128:0@lo:400:kworker.0 00000100:00080000:0.0:1788612874.741773:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788612874.741776:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612875.440556:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612860/real 1788612860] req@ffff9612fc715180 x1875495932376320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612875 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612875.440584:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9612fc715180 x1875495932376320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612875 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612875.440594:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612860/real 1788612860] req@ffff9612fc715880 x1875495932376448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612875 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612875.440604:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9612fc715880 x1875495932376448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612875 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788612875.440622:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612fe89b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788612875.440646:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788612875.440664:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932376320:0@lo:8:kworker.0 00000100:00080000:1.0:1788612875.440670:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612e0943800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788612875.440675:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788612875.440678:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932376448:0@lo:8:kworker.0 00000100:00080000:2.0:1788612875.440750:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788612875.440755:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788612875.440758:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788612875.440761:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788612875.440764:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788612875.440766:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788612875.440769:0:36:0:(import.c:65:import_set_state_nolock()) ffff9612fe89b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788612875.440775:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 674 00000100:00080000:2.0:1788612875.440780:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788612875.440787:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9612fe89b800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788612875.440819:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fccc5180 x1875495932384384/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788612875.440842:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788612875.440852:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788612875.440854:0:36:0:(import.c:65:import_set_state_nolock()) ffff9612e0943800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788612875.440857:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 674 00000100:00080000:2.0:1788612875.440860:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788612875.440863:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9612e0943800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788612875.440876:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fccc6a00 x1875495932384512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788612875.440938:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932384384:0@lo:8:kworker.0 00000100:00100000:1.0:1788612875.441002:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612875.441050:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932384512:0@lo:8:kworker.0 00000100:00100000:1.0:1788612875.441071:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612875.441109:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932384384 00000100:00100000:1.0:1788612875.441116:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932384384 00000100:00100000:1.0:1788612875.441141:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932384512 00000100:00100000:1.0:1788612875.441144:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932384512 00000100:00100000:1.0:1788612875.441155:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788612875.441161:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1875495932384384:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788612875.441188:0:24265:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:1.0:1788612875.441213:0:24265:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc9c30 00002000:00100000:1.0:1788612875.441224:0:24265:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9611c7813000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788612875.441228:0:24265:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788612875.441231:0:24265:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788612875.441402:0:24265:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788612875.441421:0:24265:0:(import.c:65:import_set_state_nolock()) ffff9611c7815000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612875.441463:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875495932384384:12345-0@lo:8:kworker.0 Request processed in 300us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612875.441470:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788612875.441517:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612875.441521:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1875495932384512:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788612875.441540:0:24265:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1788612875.470981:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fccc5180 x1875495932384384/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788612895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612875.470997:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788612875.471009:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788612875.471018:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788612875.471024:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788612875.471027:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612fe89b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788612875.471054:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788612875.471077:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932384384:0@lo:8:kworker.0 00000004:00080000:3.0:1788612875.471187:0:23500:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788612875.471212:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1875495932384768:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788612875.471276:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612875.471317:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0dc780 going to sleep for 11 seconds 00000100:00100000:0.0:1788612875.472391:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932384640:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788612875.472439:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612875.472578:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932384640 00000100:00100000:3.0:1788612875.472585:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932384640 00000100:00100000:3.0:1788612875.472646:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612875.472656:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fda19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875495932384640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788612875.472686:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788612875.472730:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fda19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875495932384640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612875.472737:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788612875.472773:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c80ef800 x1875495932384640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612875.472790:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932384640:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788612875.472889:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612875.473557:0:24264:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788612875.473566:0:24264:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:2.0:1788612875.476562:0:23499:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788612875.476665:0:23499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 689860187663ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788612875.476672:0:23499:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788612875.481056:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1875495932384512:12345-0@lo:8:kworker.0 Request processed in 39524us (39974us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788612875.481070:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788612875.481097:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932384768 00000100:00100000:1.0:1788612875.481104:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932384768 00000100:00100000:1.0:1788612875.481155:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612875.481162:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23500:x1875495932384768:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:0.0:1788612875.481405:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612e0943800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612875.481411:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788612875.481415:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932384512:0@lo:8:kworker.0 00000004:00080000:0.0:1788612875.486340:0:23490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1788612875.490102:0:24266:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788612875.490111:0:24266:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788612875.490254:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23500:x1875495932384768:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9088us (18973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612875.490265:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788612875.492278:0:23500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c80ef480 x1875495932384768/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788612891 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612875.492307:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1875495932384768:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788612875.492324:0:23500:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788612875.492630:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1875495932384896:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788612875.492685:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612875.492726:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6936cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612875.492751:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932384896 00000100:00100000:0.0:1788612875.492759:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932384896 00000100:00100000:0.0:1788612875.492825:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788612875.492836:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23500:x1875495932384896:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788612875.492863:0:24264:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1788612875.492915:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23500:x1875495932384896:12345-0@lo:5:osp-pre-0-1.0 Request processed in 80us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612875.492921:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788612875.492989:0:23500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c80ef480 x1875495932384896/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612891 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612875.493000:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1875495932384896:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788612875.493009:0:23500:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788612875.493033:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1875495932385024:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788612875.493056:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612875.493078:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c6936cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612875.493094:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932385024 00000100:00100000:0.0:1788612875.493100:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932385024 00000100:00100000:0.0:1788612875.493129:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788612875.493137:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23500:x1875495932385024:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788612875.493163:0:24265:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:3.0:1788612875.520183:0:24260:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1788612875.520201:0:24260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788612875.520533:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23500:x1875495932385024:12345-0@lo:5:osp-pre-0-1.0 Request processed in 27391us (27470us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788612875.520546:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788612875.520652:0:23500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c80ef480 x1875495932385024/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612891 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612875.520665:0:23500:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788612875.520672:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1875495932385024:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788612875.520690:0:23500:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1788612875.520742:0:23500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23500:1875495932385152:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788612875.520782:0:23500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612875.520831:0:23500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e02a63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612875.521475:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932385152 00000100:00100000:0.0:1788612875.521521:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932385152 00000100:00100000:0.0:1788612875.521562:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788612875.521580:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23500:x1875495932385152:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788612875.521641:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23500:x1875495932385152:12345-0@lo:900:osp-pre-0-1.0 Request processed in 63us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612875.521648:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788612875.521754:0:23500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c80ef480 x1875495932385152/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788612891 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612875.521766:0:23500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23500:1875495932385152:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1788612875.637106:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612876.655857:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612876.784778:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932385280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612876.784848:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612876.784906:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932385280 00000100:00100000:1.0:1788612876.784913:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932385280 00000100:00100000:1.0:1788612876.784958:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788612876.784968:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932385280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788612876.785001:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788612876.785044:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932385280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612876.785051:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788612876.785111:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932385280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612876.787334:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788612876.787355:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fda1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932385408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788612876.787417:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612876.787461:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932385408 00000100:00100000:0.0:1788612876.787469:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932385408 00000100:00100000:0.0:1788612876.787535:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788612876.787545:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fda19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932385408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788612876.787576:0:22762:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788612876.787618:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fda19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932385408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612876.787625:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788612876.787670:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fda1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932385408:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788612877.680048:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612878.703830:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612879.727639:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788612879.820053:0:25078:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788612879.820057:0:25078:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788612879.820059:0:25078:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788612879.820168:0:25078:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9612e0944800 00000020:01000004:2.0:1788612879.820186:0:25078:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788612879.820200:0:25078:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788612879.820214:0:25078:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9611c5a24d40) 00000020:00000080:2.0:1788612879.820231:0:25078:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788612879.969241:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788612879.972429:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788612879.979922:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788612879.980541:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788612879.980802:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788612879.984080:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788612879.984701:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:1.0:1788612879.994386:0:25078:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788612879.994668:0:25078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788612879.994681:0:25078:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788612879.994695:0:25078:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1f8616bf0bc9c3e 00000020:01000004:1.0:1788612879.994702:0:25078:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788612879.994724:0:25078:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788612879.994728:0:25078:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788612879.994733:0:25078:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788612879.994764:0:25078:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788612879.994767:0:25078:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788612880.048193:0:25078:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788612880.048234:0:25078:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.130@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788612880.048239:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788612880.048241:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788612880.048242:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612880.048243:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612880.048244:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612880.048246:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612880.048247:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788612880.048248:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612880.048250:0:25078:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788612880.048254:0:25078:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788612880.048256:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788612880.048257:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788612880.048258:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612880.048259:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612880.048260:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612880.048268:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612880.048269:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788612880.048271:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612880.048272:0:25078:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788612880.048302:0:25078:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788612880.048323:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932385536:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788612880.048404:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612880.048603:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c65cf180 going to sleep for 11 seconds 00000100:00100000:1.0:1788612880.052655:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932385536 00000100:00100000:1.0:1788612880.052673:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932385536 00000100:00100000:1.0:1788612880.052754:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788612880.052766:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+21:25078:x1875495932385536:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788612880.052804:0:22751:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788612880.052808:0:22751:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788612880.052812:0:22751:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788612880.053580:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+21:25078:x1875495932385536:12345-0@lo:253:mount.lustre.0 Request processed in 815us (5174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612880.053592:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788612880.055099:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932385536:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788612880.055134:0:25078:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788612880.055138:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788612880.055139:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788612880.055141:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788612880.055142:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788612880.055143:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788612880.055145:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788612880.055146:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788612880.055148:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788612880.055150:0:25078:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788612880.055172:0:25078:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9612e0944800 from lustre-OST0001 10000000:01000000:3.0:1788612880.055200:0:25078:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788612880.055203:0:25078:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788612880.055211:0:25078:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9612d1e63380 local copy 00010000:00010000:3.0:1788612880.055221:0:25078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612e81dae00/0x1f8616bf0bc9958 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc995f expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612880.055313:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932385664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612880.055365:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612880.055396:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c65cf780 going to sleep for 11 seconds 00000100:00100000:0.0:1788612880.055503:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932385664 00000100:00100000:0.0:1788612880.055510:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932385664 00000100:00100000:0.0:1788612880.055560:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788612880.055570:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+21:25078:x1875495932385664:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788612880.055643:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+21:25078:x1875495932385664:12345-0@lo:501:mount.lustre.0 Request processed in 75us (277us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788612880.055651:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788612880.057159:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932385664:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788612880.057181:0:25078:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788612880.057212:0:25078:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788612880.057220:0:25078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612e81dae00/0x1f8616bf0bc9958 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc995f expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612880.057231:0:25078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612e81dae00/0x1f8616bf0bc9958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc995f expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612880.057260:0:25078:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9612e0944800 10000000:01000000:3.0:1788612880.057275:0:25078:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788612880.057281:0:25078:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788612880.057284:0:25078:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788612880.057289:0:25078:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788612880.057292:0:25078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788612880.057319:0:25078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612e81db400/0x1f8616bf0bc9c45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612880.057327:0:25078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612e81db400/0x1f8616bf0bc9c45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612880.057338:0:25078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612e81db400/0x1f8616bf0bc9c45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612880.057355:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932385792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788612880.057400:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612880.057443:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c65cf780 going to sleep for 11 seconds 00000100:00100000:2.0:1788612880.057548:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932385792 00000100:00100000:2.0:1788612880.057554:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932385792 00000100:00100000:2.0:1788612880.057602:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788612880.057611:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+21:25078:x1875495932385792:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612880.057621:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612880.057633:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc9c4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9c45 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.057654:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc9c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9c45 expref: 22 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.057675:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612f7b37a00/0x1f8616bf0bc9c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9c45 expref: 22 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.057684:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b37a00, rc 0) 00000100:00100000:2.0:1788612880.057719:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+22:25078:x1875495932385792:12345-0@lo:101:mount.lustre.0 Request processed in 109us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612880.057726:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788612880.057761:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932385792:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612880.057772:0:25078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612e81db400/0x1f8616bf0bc9c45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9c4c expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.057782:0:25078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612e81db400/0x1f8616bf0bc9c45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9c4c expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788612880.059294:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1788612880.063983:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612880.065936:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788612880.065994:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788612880.066009:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788612880.066021:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788612880.066033:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788612880.066045:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788612880.066057:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788612880.066067:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788612880.066079:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1788612880.066101:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1788612880.066107:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1788612880.066232:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932385920:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612880.070641:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612880.070710:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d1e6bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612880.070935:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932385920 00000100:00100000:3.0:1788612880.070945:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932385920 00000100:00100000:3.0:1788612880.070999:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788612880.071009:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+22:25078:x1875495932385920:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788612880.071176:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+22:25078:x1875495932385920:12345-0@lo:501:mount.lustre.0 Request processed in 168us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612880.071184:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788612880.072433:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932385920:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612880.072536:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932386048:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612880.072611:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612880.072652:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d1e6bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612880.075391:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932386048 00000100:00100000:3.0:1788612880.075409:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932386048 00000100:00100000:3.0:1788612880.075525:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788612880.075536:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+22:25078:x1875495932386048:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788612880.076356:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+22:25078:x1875495932386048:12345-0@lo:503:mount.lustre.0 Request processed in 818us (3741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612880.076372:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788612880.076557:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932386048:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788612880.076995:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788612880.077074:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932386176:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612880.077122:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612880.077164:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0018f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612880.077233:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932386176 00000100:00100000:1.0:1788612880.077239:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932386176 00000100:00100000:1.0:1788612880.077286:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788612880.077294:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+22:25078:x1875495932386176:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612880.077723:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+22:25078:x1875495932386176:12345-0@lo:502:mount.lustre.0 Request processed in 427us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612880.077736:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788612880.078725:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932386176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788612880.078967:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788612880.078996:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788612880.079010:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788612880.079024:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788612880.079039:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788612880.079052:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788612880.079063:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788612880.079075:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788612880.079088:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1788612880.079123:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932386304:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788612880.079183:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612880.079300:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c88bf000 going to sleep for 11 seconds 00000100:00100000:0.0:1788612880.086425:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932386304 00000100:00100000:0.0:1788612880.086468:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932386304 00000100:00100000:1.0:1788612880.086708:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788612880.086719:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+22:25078:x1875495932386304:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612880.086887:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+22:25078:x1875495932386304:12345-0@lo:502:mount.lustre.0 Request processed in 168us (7701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612880.086895:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788612880.086963:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932386304:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788612880.087053:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1788612880.087066:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788612880.088104:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788612880.088112:0:25082:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788612880.088118:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612880.088121:0:25082:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788612880.088127:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788612880.088141:0:25082:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9612ea2499c0) 00000020:00000080:1.0:1788612880.088180:0:25082:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788612880.088188:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788612880.088257:0:25082:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9612e0944800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788612880.088338:0:25082:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788612880.088347:0:25082:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1f8616bf0bc9c5a 00010000:00010000:1.0:1788612880.104757:0:25082:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788612880.105675:0:25082:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:1.0:1788612880.106964:0:25082:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000040:00080000:1.0:1788612880.114095:0:22790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1788612880.120111:0:25082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788612880.120124:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612880.120131:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612880.120132:0:25082:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788612880.120135:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612880.120139:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612880.120140:0:25082:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788612880.120143:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788612880.120145:0:25082:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788612880.120147:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612880.120149:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612880.120150:0:25082:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788612880.120152:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788612880.120155:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612880.120156:0:25082:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788612880.120159:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788612880.120188:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788612880.120191:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788612880.120199:0:25082:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788612880.120203:0:25082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1788612880.128617:0:25078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788612880.128676:0:25078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788612880.128704:0:25078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612e81db400/0x1f8616bf0bc9c45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9c4c expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612880.128726:0:25078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612e81db400/0x1f8616bf0bc9c45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9c4c expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788612880.128735:0:25078:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612e0944800 from 1 10000000:01000000:1.0:1788612880.128738:0:25078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788612880.128778:0:25078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d0800/0x1f8616bf0bc9c61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612880.128786:0:25078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c13d0800/0x1f8616bf0bc9c61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612880.128798:0:25078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c13d0800/0x1f8616bf0bc9c61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612880.128825:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932386432:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788612880.128894:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612880.131604:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612d1f99900 going to sleep for 11 seconds 00000100:00100000:2.0:1788612880.140436:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932386432 00000100:00100000:2.0:1788612880.140460:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932386432 00000100:00100000:3.0:1788612880.140678:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788612880.140690:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+22:25078:x1875495932386432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788612880.140706:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612880.140726:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612e81da600/0x1f8616bf0bc9c68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9c61 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612880.140754:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612e81da600/0x1f8616bf0bc9c68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9c61 expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612880.140765:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612e81da600/0x1f8616bf0bc9c68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9c61 expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612880.140774:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612e81da600, rc 0) 00000100:00100000:3.0:1788612880.140860:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+23:25078:x1875495932386432:12345-0@lo:101:mount.lustre.0 Request processed in 171us (11965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612880.140881:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788612880.141099:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932386432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788612880.141119:0:25078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c13d0800/0x1f8616bf0bc9c61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9c68 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.141129:0:25078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c13d0800/0x1f8616bf0bc9c61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9c68 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788612880.142334:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788612880.142664:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612880.142828:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788612880.142854:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788612880.142870:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788612880.142884:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788612880.142915:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788612880.142931:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788612880.142942:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788612880.142953:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788612880.142964:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788612880.143295:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788612880.143309:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788612880.143327:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788612880.143332:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788612880.143412:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932386560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612880.143584:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612880.143659:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e00183c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788612880.160822:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932386560 00000100:00100000:0.0:1788612880.160837:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932386560 00000100:00100000:1.0:1788612880.161037:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788612880.161048:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+23:25078:x1875495932386560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788612880.161223:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+23:25078:x1875495932386560:12345-0@lo:501:mount.lustre.0 Request processed in 176us (17637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612880.161232:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788612880.161392:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932386560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612880.161468:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932386688:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612880.161544:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612880.161571:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e00183c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612880.161623:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932386688 00000100:00100000:1.0:1788612880.161628:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932386688 00000100:00100000:1.0:1788612880.161656:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788612880.161663:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+23:25078:x1875495932386688:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788612880.161748:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+23:25078:x1875495932386688:12345-0@lo:503:mount.lustre.0 Request processed in 85us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612880.161762:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788612880.161878:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932386688:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788612880.162255:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788612880.162391:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932386816:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612880.162429:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612880.162464:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c53d1480 going to sleep for 11 seconds 00000100:00100000:1.0:1788612880.162578:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932386816 00000100:00100000:1.0:1788612880.162583:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932386816 00000100:00100000:1.0:1788612880.162611:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788612880.162619:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+23:25078:x1875495932386816:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612880.162702:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+23:25078:x1875495932386816:12345-0@lo:502:mount.lustre.0 Request processed in 82us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612880.162709:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788612880.162806:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932386816:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788612880.162971:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788612880.163000:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788612880.163014:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788612880.163029:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788612880.163042:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788612880.163056:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788612880.163083:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788612880.163096:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788612880.163107:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788612880.163119:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788612880.163130:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788612880.163151:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932386944:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612880.163187:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612880.163218:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e0018f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612880.163337:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932386944 00000100:00100000:1.0:1788612880.163342:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932386944 00000100:00100000:1.0:1788612880.163380:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788612880.163387:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+23:25078:x1875495932386944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788612880.163503:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+23:25078:x1875495932386944:12345-0@lo:502:mount.lustre.0 Request processed in 116us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612880.163510:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788612880.166156:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932386944:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788612880.166588:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1788612880.166605:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788612880.167839:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612880.167850:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612880.167852:0:25086:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788612880.167859:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9612e0944800 00000020:00000080:1.0:1788612880.167862:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788612880.167869:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612880.167872:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612880.167873:0:25086:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788612880.167875:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612880.167877:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612880.167878:0:25086:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788612880.167881:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9612e0944800 00000020:00000080:1.0:1788612880.167883:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788612880.168016:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612880.168022:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612880.168023:0:25086:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788612880.168026:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612880.168028:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612880.168030:0:25086:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788612880.168034:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9612e0944800 00000020:00000080:1.0:1788612880.168036:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788612880.169431:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612880.169440:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612880.169441:0:25086:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788612880.169445:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788612880.169449:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612880.169450:0:25086:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788612880.169464:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9612e0944800 00000020:00000080:1.0:1788612880.169467:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788612880.169536:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788612880.169540:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788612880.169541:0:25086:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788612880.169544:0:25086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788612880.169732:0:25078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788612880.169780:0:25078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788612880.169810:0:25078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c13d0800/0x1f8616bf0bc9c61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9c68 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.169834:0:25078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c13d0800/0x1f8616bf0bc9c61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9c68 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612880.169890:0:25078:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788612880.169893:0:25078:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9612e0944800 10000000:01000000:2.0:1788612880.169896:0:25078:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9612e0944800 10000000:01000000:2.0:1788612880.169900:0:25078:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788612880.169906:0:25078:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9612e0944800 from 1 10000000:01000000:2.0:1788612880.169908:0:25078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788612880.169943:0:25078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36200/0x1f8616bf0bc9c6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.172556:0:25078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612f7b36200/0x1f8616bf0bc9c6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.172573:0:25078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612f7b36200/0x1f8616bf0bc9c6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612880.172601:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932387072:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788612880.172667:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612880.172706:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e00183c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612880.175613:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932387072 00000100:00100000:1.0:1788612880.175625:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932387072 00000100:00100000:1.0:1788612880.175681:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788612880.175690:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+23:25078:x1875495932387072:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612880.175705:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612880.175725:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c13d0000/0x1f8616bf0bc9c76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9c6f expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612880.175752:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c13d0000/0x1f8616bf0bc9c76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9c6f expref: 24 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612880.175762:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c13d0000/0x1f8616bf0bc9c76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9c6f expref: 24 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612880.175779:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d0000, rc 0) 00000100:00100000:1.0:1788612880.175846:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+24:25078:x1875495932387072:12345-0@lo:101:mount.lustre.0 Request processed in 157us (3178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612880.175854:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788612880.175916:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932387072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788612880.175936:0:25078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612f7b36200/0x1f8616bf0bc9c6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9c76 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612880.175945:0:25078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612f7b36200/0x1f8616bf0bc9c6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9c76 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788612880.187449:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788612880.187793:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788612880.187985:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788612880.188013:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788612880.188026:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788612880.188039:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788612880.188053:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788612880.188068:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788612880.188095:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788612880.188111:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788612880.188126:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788612880.188140:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788612880.188155:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788612880.188169:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788612880.188184:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788612880.188199:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788612880.188213:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788612880.188243:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788612880.188257:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788612880.188286:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788612880.188300:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788612880.188311:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788612880.188324:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788612880.188338:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788612880.188349:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788612880.188361:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788612880.188372:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788612880.188383:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788612880.188393:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788612880.188407:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788612880.188419:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788612880.188430:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788612880.188441:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788612880.188506:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788612880.188525:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788612880.188539:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788612880.188552:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788612880.188564:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788612880.188575:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788612880.188587:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788612880.188598:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788612880.188619:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788612880.188630:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788612880.188641:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788612880.188652:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788612880.188663:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788612880.188673:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788612880.188684:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788612880.188696:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788612880.188721:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788612880.188835:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788612880.188858:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788612880.188874:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788612880.188879:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788612880.188976:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932387200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612880.189045:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612880.189094:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea3d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788612880.189125:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932387200 00000100:00100000:2.0:1788612880.189133:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932387200 00000100:00100000:2.0:1788612880.189175:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788612880.189183:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:25078:x1875495932387200:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612880.189296:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:25078:x1875495932387200:12345-0@lo:501:mount.lustre.0 Request processed in 113us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612880.189304:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788612880.189341:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932387200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788612880.189372:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932387328:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612880.189410:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612880.189422:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea3d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788612880.189440:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932387328 00000100:00100000:2.0:1788612880.189449:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932387328 00000100:00100000:2.0:1788612880.189507:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788612880.189514:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:25078:x1875495932387328:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788612880.189588:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:25078:x1875495932387328:12345-0@lo:503:mount.lustre.0 Request processed in 74us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612880.189594:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788612880.189631:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932387328:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788612880.189958:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788612880.190016:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932387456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612880.190054:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612880.190070:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea3d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788612880.190091:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932387456 00000100:00100000:2.0:1788612880.190094:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932387456 00000100:00100000:2.0:1788612880.190114:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788612880.190120:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:25078:x1875495932387456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612880.190201:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:25078:x1875495932387456:12345-0@lo:502:mount.lustre.0 Request processed in 80us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612880.190207:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788612880.190241:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932387456:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788612880.190376:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788612880.190401:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788612880.190416:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788612880.190430:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788612880.190444:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788612880.195677:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788612880.195732:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788612880.195749:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788612880.195793:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788612880.195810:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788612880.195826:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788612880.195841:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788612880.195854:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788612880.195867:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788612880.195880:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788612880.195894:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788612880.195907:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788612880.195922:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788612880.195934:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788612880.195946:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788612880.195959:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788612880.195972:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788612880.195987:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788612880.196000:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788612880.196028:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788612880.196045:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788612880.196061:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788612880.196075:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788612880.196087:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788612880.196101:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788612880.196115:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788612880.196129:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788612880.196144:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788612880.196156:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788612880.196170:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788612880.196182:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788612880.196196:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788612880.196209:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788612880.196221:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788612880.196234:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788612880.196274:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788612880.196302:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788612880.196316:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788612880.196330:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788612880.196344:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788612880.196358:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788612880.196373:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788612880.196387:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788612880.196444:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932387584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612880.196569:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612880.196614:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea3d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788612880.196643:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932387584 00000100:00100000:2.0:1788612880.196651:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932387584 00000100:00100000:2.0:1788612880.196692:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788612880.196701:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:25078:x1875495932387584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612880.197450:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:25078:x1875495932387584:12345-0@lo:502:mount.lustre.0 Request processed in 747us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612880.197469:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788612880.197559:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932387584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788612880.197772:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788612880.197799:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788612880.197828:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932387712:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612880.197872:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612880.197895:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea3d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788612880.197933:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932387712 00000100:00100000:2.0:1788612880.197940:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932387712 00000100:00100000:2.0:1788612880.197967:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788612880.197975:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:25078:x1875495932387712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788612880.198055:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:25078:x1875495932387712:12345-0@lo:502:mount.lustre.0 Request processed in 80us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612880.198061:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788612880.198099:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932387712:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788612880.198132:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788612880.198140:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788612880.206085:0:25091:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788612880.206104:0:25091:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9611c5a20000) 00000020:00000080:2.0:1788612880.206128:0:25091:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788612880.206238:0:25091:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9612e0944800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788612880.206242:0:25091:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9612e0944800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788612880.206244:0:25091:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9612e0944800 3 00010000:00080000:2.0:1788612880.206285:0:25091:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9611c10bf000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1788612880.207990:0:25091:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788612880.220707:0:25091:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788612880.220761:0:25091:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788612880.220775:0:25091:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1f8616bf0bc9c84 00000100:00080000:3.0:1788612880.220786:0:25091:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788612880.220792:0:25091:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9611c10bf000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612880.220824:0:25091:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c80ece00 x1875495932387840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788612880.220853:0:25091:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788612880.220904:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612880.220908:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612880.220910:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612880.220914:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788612880.220942:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788612880.220945:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788612880.220947:0:8:0:(import.c:65:import_set_state_nolock()) ffff9612e0943800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788612880.220951:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 689 00000100:00080000:3.0:1788612880.220956:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788612880.220959:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9612e0943800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788612880.220971:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9611c80edf80 x1875495932388480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788612880.221014:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932387968:0@lo:400:kworker.0 00000100:00100000:3.0:1788612880.221075:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612880.221119:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932388608:0@lo:400:kworker.0 00000100:00100000:3.0:1788612880.221144:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612880.221164:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612880.221170:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932388352:0@lo:400:kworker.0 00000100:00100000:3.0:1788612880.221191:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612880.221220:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932388608 00000100:00100000:3.0:1788612880.221227:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932388608 00000100:00100000:3.0:1788612880.221280:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788612880.221289:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932388608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612880.221335:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932388608:12345-0@lo:400:kworker.0 Request processed in 48us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612880.221342:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788612880.221364:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932388352 00000100:00100000:3.0:1788612880.221367:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932388352 00000100:00100000:3.0:1788612880.221400:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788612880.221406:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932388352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612880.221437:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932388352:12345-0@lo:400:kworker.0 Request processed in 31us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612880.221443:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788612880.221511:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c80ec000 x1875495932388352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612880.221524:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932388352:0@lo:400:kworker.0 00010000:00080000:3.0:1788612880.221534:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c80edc00 x1875495932388608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612880.221541:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932388608:0@lo:400:kworker.0 00000100:00080000:3.0:1788612880.221563:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612880.222572:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932388096:0@lo:400:kworker.0 00000100:00100000:1.0:1788612880.222623:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612880.222657:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932388736:0@lo:400:kworker.0 00000100:00100000:1.0:1788612880.222680:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612880.222703:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788612880.222709:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932388224:0@lo:400:kworker.0 00000100:00100000:1.0:1788612880.222732:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612880.222751:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932388864:0@lo:400:kworker.0 00000100:00100000:1.0:1788612880.222771:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612880.222805:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932387968 00000100:00100000:1.0:1788612880.222811:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932387968 00000100:00100000:1.0:1788612880.222843:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932388224 00000100:00100000:1.0:1788612880.222847:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932388224 00000100:00100000:1.0:1788612880.222863:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788612880.222871:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932387968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612880.222923:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932387968:12345-0@lo:400:kworker.0 Request processed in 53us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612880.222931:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788612880.222945:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788612880.222951:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932388224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612880.222981:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932388224:12345-0@lo:400:kworker.0 Request processed in 30us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612880.222987:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788612880.223018:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932388096 00000100:00100000:1.0:1788612880.223021:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932388096 00000100:00100000:1.0:1788612880.223042:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932388736 00000100:00100000:1.0:1788612880.223045:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932388736 00000100:00100000:1.0:1788612880.223064:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932388864 00000100:00100000:1.0:1788612880.223068:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932388864 00000100:00100000:1.0:1788612880.223080:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788612880.223086:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932388096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612880.223117:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932388096:12345-0@lo:400:kworker.0 Request processed in 30us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612880.223123:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788612880.223135:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788612880.223141:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc73a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932388736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612880.223166:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc73a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932388736:12345-0@lo:400:kworker.0 Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612880.223171:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788612880.223183:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788612880.223189:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932388864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612880.223227:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932388864:12345-0@lo:400:kworker.0 Request processed in 38us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612880.223233:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788612880.223685:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932387840:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1788612880.224378:0:25091:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788612880.224394:0:25091:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9612c93ecd40) 00000020:00000080:3.0:1788612880.224417:0:25091:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788612880.224543:0:25091:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9612e0944800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788612880.224548:0:25091:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9612e0944800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788612880.224550:0:25091:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9612e0944800 3 00010000:00080000:3.0:1788612880.224584:0:25091:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9611c8f1c800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.130@tcp at head 00000100:00100000:1.0:1788612880.227781:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932387968:0@lo:400:kworker.0 00000100:00080000:3.0:1788612880.227865:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788612880.227870:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612880.230917:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612880.230972:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932388480:0@lo:8:kworker.0 00000100:00100000:0.0:1788612880.231005:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788612880.231291:0:25091:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1788612880.231502:0:25091:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788612880.231548:0:25091:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788612880.231558:0:25091:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x1f8616bf0bc9c92 00000100:00080000:2.0:1788612880.231566:0:25091:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788612880.231572:0:25091:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9611c8f1c800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788612880.231600:0:25091:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fccc5c00 x1875495932388992/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788612880.231620:0:25091:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788612880.231640:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788612880.231644:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788612880.231647:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788612880.231659:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788612880.233115:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875495932388992:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788612880.233178:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612880.233529:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932387840 00000100:00100000:0.0:1788612880.233537:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932387840 00000100:00100000:0.0:1788612880.233570:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932388992 00000100:00100000:0.0:1788612880.233574:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932388992 00000100:00100000:0.0:1788612880.233589:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788612880.233596:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fda1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932387840:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788612880.233620:0:22758:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 694 last 0 00000020:00000080:0.0:1788612880.233654:0:22758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1f8616bf0bc9c99 00000004:00100000:0.0:1788612880.233667:0:22758:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788612880.233699:0:22758:0:(import.c:65:import_set_state_nolock()) ffff9611c1c8d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612880.233750:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fda1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875495932387840:12345-0@lo:38:llog_process_th.0 Request processed in 152us (2839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612880.233757:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788612880.233772:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788612880.233776:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fda1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875495932388992:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788612880.233799:0:22758:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 694 last 0 00000020:00000080:0.0:1788612880.233821:0:22758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x1f8616bf0bc9ca0 00000004:00100000:0.0:1788612880.233828:0:22758:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788612880.233845:0:22758:0:(import.c:65:import_set_state_nolock()) ffff961300669800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612880.233875:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fda1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875495932388992:12345-0@lo:38:llog_process_th.0 Request processed in 97us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612880.233882:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788612880.233916:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fccc5c00 x1875495932388992/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612880.233926:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788612880.233933:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1788612880.233940:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788612880.233944:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788612880.233947:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c8f1c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788612880.233952:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875495932388992:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788612880.233966:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c80ece00 x1875495932387840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788612890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612880.233973:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788612880.233977:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1788612880.233980:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788612880.233983:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788612880.233984:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c10bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788612880.233988:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875495932387840:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788612880.234443:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1788612880.234525:0:25078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788612880.234556:0:25078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788612880.234577:0:25078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36200/0x1f8616bf0bc9c6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9c76 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.234589:0:25078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612f7b36200/0x1f8616bf0bc9c6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9c76 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788612880.234638:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788612880.234641:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788612880.234642:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612880.234643:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612880.234644:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612880.234646:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612880.234647:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788612880.234648:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612880.234649:0:25078:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788612880.234653:0:25078:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788612880.234655:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788612880.234656:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788612880.234658:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612880.234659:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612880.234660:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612880.234661:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612880.234662:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788612880.234663:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612880.234664:0:25078:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788612880.234683:0:25078:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788612880.234696:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932389120:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788612880.234739:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612880.234763:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7952600 going to sleep for 11 seconds 00000100:00100000:2.0:1788612880.234778:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932389120 00000100:00100000:2.0:1788612880.234787:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932389120 00000100:00100000:2.0:1788612880.234817:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788612880.234823:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:25078:x1875495932389120:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788612880.234844:0:22751:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788612880.234856:0:22751:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788612880.236413:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932388224:0@lo:400:kworker.0 00000100:00100000:1.0:1788612880.236443:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932388480 00000100:00100000:1.0:1788612880.236449:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932388480 00000100:00100000:1.0:1788612880.236508:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788612880.236514:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fda19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875495932388480:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788612880.236594:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fda19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875495932388480:12345-0@lo:8:kworker.0 Request processed in 78us (5587us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788612880.236602:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788612880.236645:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788612880.236651:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612e0943800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788612880.236655:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788612880.236658:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932388480:0@lo:8:kworker.0 00010000:00080000:1.0:1788612880.236689:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9612fc715880 x1875495932388864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612880.236699:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932388864:0@lo:400:kworker.0 00010000:00080000:1.0:1788612880.236710:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c80eca80 x1875495932388096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612880.236718:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932388096:0@lo:400:kworker.0 00010000:00080000:1.0:1788612880.236728:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9611c80ef480 x1875495932388736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612880.236750:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932388736:0@lo:400:kworker.0 20000000:01000000:2.0:1788612880.244107:0:22751:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788612880.244127:0:22751:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788612880.244321:0:22772:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788612880.244326:0:22772:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788612880.244349:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9612e81db800/0x1f8616bf0bc9ca7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612880.244369:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9c14 expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612880.244377:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc9c29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9c22 expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612880.244384:0:22772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9612e81db800/0x1f8616bf0bc9ca7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612880.244423:0:22772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc9c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9c22 expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612880.244438:0:22772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc9c29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9c22 expref: 24 pid: 22751 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612880.244461:0:22772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc717480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1875495932389248:0@lo:104: 00000100:00100000:3.0:1788612880.244557:0:22772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788612880.244620:0:22772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9c14 expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612880.244629:0:22772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9c14 expref: 24 pid: 22751 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612880.244638:0:22772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1875495932389376:0@lo:104: 00000100:00100000:3.0:1788612880.244661:0:22772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612880.244682:0:22772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c4fa86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612880.244777:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932389248 00000100:00100000:2.0:1788612880.244784:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932389248 00000100:00100000:2.0:1788612880.244820:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932389376 00000100:00100000:2.0:1788612880.244823:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932389376 00000100:00100000:2.0:1788612880.244840:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788612880.244849:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc716d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6b44f55-8b88-4406-a946-d178714afb91+4:22772:x1875495932389248:12345-0@lo:104: 00010000:00010000:2.0:1788612880.244863:0:22739:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9611c67a3e00/0x1f8616bf0bc9c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9c29 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.244914:0:22739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788612880.244921:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc716d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6b44f55-8b88-4406-a946-d178714afb91+4:22772:x1875495932389248:12345-0@lo:104: Request processed in 73us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612880.244927:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788612880.244944:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612880.244950:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6b44f55-8b88-4406-a946-d178714afb91+3:22772:x1875495932389376:12345-0@lo:104: 00010000:00010000:2.0:1788612880.244957:0:22739:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc9c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9c1b expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.244989:0:22739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788612880.244994:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6b44f55-8b88-4406-a946-d178714afb91+3:22772:x1875495932389376:12345-0@lo:104: Request processed in 46us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612880.244999:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788612880.245022:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788612880.245028:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9611c67a3e00/0x1f8616bf0bc9c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9c29 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245035:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3e00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:2.0:1788612880.245039:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a3e00/0x1f8616bf0bc9c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc9c29 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245047:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9611c67a3e00/0x1f8616bf0bc9c22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc9c29 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612880.245054:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9611c67a3e00/0x1f8616bf0bc9c22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc9c29 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612880.245060:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788612880.245088:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9611c67a3e00/0x1f8616bf0bc9c22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9c29 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245094:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612880.245115:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9611c67a3e00/0x1f8616bf0bc9c22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9c29 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245123:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9611c67a3e00/0x1f8616bf0bc9c22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9c29 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245136:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612880.245139:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc9c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9c1b expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245144:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d1e00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:2.0:1788612880.245147:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc9c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc9c1b expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245159:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc9c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc9c1b expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788612880.245165:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc9c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc9c1b expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612880.245169:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788612880.245182:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc9c14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9c1b expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245188:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788612880.245194:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc9c14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9c1b expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245199:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c13d1e00/0x1f8616bf0bc9c14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9c1b expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245212:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612880.245213:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612880.245215:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612880.245222:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612880.245239:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6b44f55-8b88-4406-a946-d178714afb91:3650:1875495932389504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612880.245279:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612880.245305:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612880.245311:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6b44f55-8b88-4406-a946-d178714afb91:3650:1875495932389632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612880.245332:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612880.245363:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932389504 00000100:00100000:2.0:1788612880.245368:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932389504 00010000:00010000:2.0:1788612880.245384:0:22742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc9c29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9c22 expref: 25 pid: 22751 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612880.245411:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932389632 00000100:00100000:2.0:1788612880.245415:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932389632 00010000:00010000:2.0:1788612880.245426:0:22742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9c14 expref: 26 pid: 22751 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612880.245437:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788612880.245443:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6b44f55-8b88-4406-a946-d178714afb91+26:3650:x1875495932389504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612880.245463:0:22742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612880.245469:0:22742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc9c29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9c22 expref: 26 pid: 22751 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245501:0:22742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc9c29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9c22 expref: 26 pid: 22751 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245516:0:22742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612880.245544:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6b44f55-8b88-4406-a946-d178714afb91+26:3650:x1875495932389504:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612880.245551:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788612880.245564:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612880.245570:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6b44f55-8b88-4406-a946-d178714afb91+25:3650:x1875495932389632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612880.245578:0:22742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612880.245582:0:22742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9c14 expref: 25 pid: 22751 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245591:0:22742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9c14 expref: 25 pid: 22751 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245603:0:22742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9612e81db800/0x1f8616bf0bc9ca7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245616:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612e81db800/0x1f8616bf0bc9ca7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788612880.245628:0:22742:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005501093s 00010000:00010000:2.0:1788612880.245633:0:22742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612e81db800/0x1f8616bf0bc9ca7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245639:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612e81db800/0x1f8616bf0bc9ca7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245645:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9612e81db800/0x1f8616bf0bc9ca7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245651:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9612e81db800/0x1f8616bf0bc9ca7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245657:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612e81db800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612880.245661:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9612e81db800/0x1f8616bf0bc9ca7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245669:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9612e81db800/0x1f8616bf0bc9ca7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245678:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9612e81db800/0x1f8616bf0bc9ca7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245688:0:22742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612880.245711:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6b44f55-8b88-4406-a946-d178714afb91+25:3650:x1875495932389632:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612880.245717:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612880.245762:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6b44f55-8b88-4406-a946-d178714afb91:3650:1875495932389632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612880.245771:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6b44f55-8b88-4406-a946-d178714afb91:3650:1875495932389504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612880.245798:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612f7b37200/0x1f8616bf0bc9c29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9c22 expref: 24 pid: 22751 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612880.245809:0:22772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc717480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1875495932389248:0@lo:104: 00010000:00010000:2.0:1788612880.245817:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612e81dbe00/0x1f8616bf0bc9c1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9c14 expref: 23 pid: 22751 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612880.245824:0:22772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22772:1875495932389376:0@lo:104: 00010000:00010000:2.0:1788612880.245839:0:22772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9612e81db800/0x1f8616bf0bc9ca7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245848:0:22772:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9612e81db800/0x1f8616bf0bc9ca7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245854:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9612e81db800/0x1f8616bf0bc9ca7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612880.245860:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612e81db800/0x1f8616bf0bc9ca7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612880.246096:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+22:25078:x1875495932389120:12345-0@lo:253:mount.lustre.0 Request processed in 11271us (11355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612880.246104:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788612880.246352:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6b44f55-8b88-4406-a946-d178714afb91:25078:1875495932389120:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788612880.246363:0:25078:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788612880.246366:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788612880.246367:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788612880.246369:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788612880.246370:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788612880.246371:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788612880.246379:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788612880.246380:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788612880.246382:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788612880.246383:0:25078:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788612880.246400:0:25078:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1788612880.260138:0:25078:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788612880.272871:0:25078:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788612880.272880:0:25078:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788612880.272921:0:25078:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788612880.272965:0:25078:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788612880.272985:0:25078:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788612880.273013:0:25078:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788612880.273808:0:25078:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788612880.274020:0:25078:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788612880.751630:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612880.884704:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932389760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612880.884782:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612880.885020:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932389760 00000100:00100000:3.0:1788612880.885038:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932389760 00000100:00100000:3.0:1788612880.885117:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612880.885132:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932389760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788612880.885172:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788612880.885234:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932389760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612880.885242:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788612880.885746:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fc714e00 x1875495932389760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612880.885794:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932389760:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1788612881.390127:0:25145:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788612881.390356:0:25145:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788612881.781169:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612881.903751:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932389888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612881.903824:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612881.903920:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932389888 00000100:00100000:3.0:1788612881.903928:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932389888 00000100:00100000:3.0:1788612881.903984:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788612881.903993:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932389888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788612881.904024:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788612881.904159:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fda18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932390016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788612881.904189:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612881.904450:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932390016 00000100:00100000:1.0:1788612881.904455:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932390016 00000100:00100000:1.0:1788612881.904507:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788612881.904515:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fda1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932390016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788612881.904534:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788612881.904578:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fda1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932390016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612881.904585:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788612881.904631:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fda18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932390016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788612881.909638:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932389888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5636us (5803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612881.909653:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788612881.909895:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932389888:0@lo:41:osp-pre-0-1.0 10000000:01000000:2.0:1788612882.033737:0:22753:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788612882.033744:0:22753:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9611c6492800 from 14 10000000:01000000:2.0:1788612882.033749:0:22753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788612882.033796:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b37200/0x1f8616bf0bc9cae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612882.033808:0:22753:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612f7b37200/0x1f8616bf0bc9cae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612882.033820:0:22753:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612f7b37200/0x1f8616bf0bc9cae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612882.033845:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932390144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612882.036494:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612882.036538:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c78e29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612882.038107:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932390144 00000100:00100000:1.0:1788612882.038121:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932390144 00000100:00100000:1.0:1788612882.038183:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788612882.038192:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+22:22753:x1875495932390144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612882.038209:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612882.038227:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c13d1600/0x1f8616bf0bc9cb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9cae expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612882.038264:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c13d1600/0x1f8616bf0bc9cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9cae expref: 23 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612882.038276:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c13d1600/0x1f8616bf0bc9cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9cae expref: 23 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612882.038302:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c13d1600, rc 0) 00000100:00100000:1.0:1788612882.039390:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+23:22753:x1875495932390144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1192us (2908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612882.039400:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788612882.039428:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932390144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612882.039460:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612f7b37200/0x1f8616bf0bc9cae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9cb5 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612882.039471:0:22753:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612f7b37200/0x1f8616bf0bc9cae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9cb5 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612882.039680:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932390272:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788612882.039728:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612882.039780:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c78e29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612882.040030:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932390272 00000100:00100000:1.0:1788612882.040037:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932390272 00000100:00100000:1.0:1788612882.040085:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788612882.040094:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+23:22753:x1875495932390272:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788612882.040112:0:22751:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788612882.040130:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788612882.040133:0:22751:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788612882.040216:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+23:22753:x1875495932390272:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612882.040222:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788612882.041177:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932390272:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788612882.041614:0:22753:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788612882.041624:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b37200/0x1f8616bf0bc9cae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9cb5 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612882.041634:0:22753:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612f7b37200/0x1f8616bf0bc9cae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9cb5 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612882.041644:0:22753:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788612882.041646:0:22753:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9612e9172000 from 14 10000000:01000000:2.0:1788612882.041649:0:22753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788612882.041679:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36400/0x1f8616bf0bc9cbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612882.041687:0:22753:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612f7b36400/0x1f8616bf0bc9cbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612882.041697:0:22753:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612f7b36400/0x1f8616bf0bc9cbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612882.041715:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932390400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612882.041759:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612882.041792:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c78e29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612882.046513:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932390400 00000100:00100000:3.0:1788612882.046539:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932390400 00000100:00100000:3.0:1788612882.048892:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788612882.048907:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+23:22753:x1875495932390400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612882.048926:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612882.048945:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612e81dac00/0x1f8616bf0bc9cc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9cbc expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612882.048974:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612e81dac00/0x1f8616bf0bc9cc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9cbc expref: 24 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612882.048985:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612e81dac00/0x1f8616bf0bc9cc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9cbc expref: 24 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612882.048994:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612e81dac00, rc 0) 00000100:00100000:3.0:1788612882.049068:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+24:22753:x1875495932390400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (7309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612882.049075:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788612882.051696:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932390400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612882.051738:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612f7b36400/0x1f8616bf0bc9cbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9cc3 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612882.051751:0:22753:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612f7b36400/0x1f8616bf0bc9cbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9cc3 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612882.051821:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932390528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788612882.052306:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612882.052354:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c78e29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612882.052417:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932390528 00000100:00100000:3.0:1788612882.052424:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932390528 00000100:00100000:3.0:1788612882.052518:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788612882.052528:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+24:22753:x1875495932390528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788612882.052672:0:22750:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788612882.052689:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788612882.052692:0:22750:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1788612882.052868:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+24:22753:x1875495932390528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 341us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612882.052876:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788612882.059451:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932390528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788612882.059650:0:22753:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788612882.059663:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b36400/0x1f8616bf0bc9cbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9cc3 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612882.059674:0:22753:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612f7b36400/0x1f8616bf0bc9cbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9cc3 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612882.800632:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612883.321347:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612863/real 1788612863] req@ffff9612fc76f480 x1875495932377216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612883 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612883.321389:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9612fc76f480 x1875495932377216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612883 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612883.321400:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788612863/real 1788612863] req@ffff9612fc76e680 x1875495932377344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612883 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612883.321413:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9612fc76e680 x1875495932377344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788612883 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788612883.321452:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c80c2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788612883.322804:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788612883.322813:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932377216:0@lo:8:kworker.0 00000100:00080000:2.0:1788612883.322833:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612c82bb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788612883.326098:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612883.326105:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788612883.326109:0:8:0:(import.c:65:import_set_state_nolock()) ffff9611c80c2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788612883.326117:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 677 00000100:00080000:0.0:1788612883.326122:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788612883.326130:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9611c80c2800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612883.326154:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fda1a300 x1875495932390912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788612883.326166:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612883.326169:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788612883.326171:0:8:0:(import.c:65:import_set_state_nolock()) ffff9612c82bb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788612883.326175:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 677 00000100:00080000:0.0:1788612883.326178:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788612883.326181:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9612c82bb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612883.326194:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612fda18380 x1875495932391040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788612883.326221:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788612883.326225:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788612883.326227:0:8:0:(import.c:65:import_set_state_nolock()) ffff9612e0943800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788612883.326231:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9612e0943800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788612883.326942:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9612febbc380 x1875495932391552/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788612883.327019:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fda19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6b44f55-8b88-4406-a946-d178714afb91:3651:1875495932390656:0@lo:400:kworker.0 00000100:00100000:0.0:1788612883.327082:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612883.327130:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932391424:0@lo:400:kworker.0 00000100:00100000:0.0:1788612883.327153:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612883.327169:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932392064:0@lo:400:kworker.0 00000100:00100000:0.0:1788612883.327192:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612883.327229:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788612883.327236:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fda18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932391296:0@lo:400:kworker.0 00000100:00100000:3.0:1788612883.327352:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932390656 00000100:00100000:3.0:1788612883.327361:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932390656 00000100:00100000:3.0:1788612883.327404:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788612883.327413:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:3651:x1875495932390656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612883.327467:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:3651:x1875495932390656:12345-0@lo:400:kworker.0 Request processed in 54us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612883.327488:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788612883.327518:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932391424 00000100:00100000:3.0:1788612883.327522:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932391424 00000100:00100000:3.0:1788612883.327548:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788612883.327553:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932391424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612883.327582:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932391424:12345-0@lo:400:kworker.0 Request processed in 29us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612883.327587:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788612883.327600:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612883.327687:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612883.327707:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932391936:0@lo:400:kworker.0 00000100:00100000:0.0:1788612883.327728:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612883.327756:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fda19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6b44f55-8b88-4406-a946-d178714afb91:3651:1875495932390656:0@lo:400:kworker.0 00010000:00080000:0.0:1788612883.327768:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612febbea00 x1875495932391424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788612899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612883.327778:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932391424:0@lo:400:kworker.0 00000100:00100000:0.0:1788612883.327805:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fda1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932390784:0@lo:400:kworker.0 00000100:00080000:2.0:1788612883.327931:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788612883.327937:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932377344:0@lo:8:kworker.0 00000100:00100000:2.0:1788612883.327964:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fda19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932391168:0@lo:400:kworker.0 00000100:00100000:2.0:1788612883.327993:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612883.328010:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932391808:0@lo:400:kworker.0 00000100:00100000:2.0:1788612883.328033:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612883.328061:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fda1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932390912:0@lo:8:kworker.0 00000100:00100000:2.0:1788612883.328086:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612883.328111:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fda18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932391040:0@lo:8:kworker.0 00000100:00100000:2.0:1788612883.328136:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612883.328152:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932391552:0@lo:8:kworker.0 00000100:00100000:2.0:1788612883.328174:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612883.328953:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932392064 00000100:00100000:3.0:1788612883.328962:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932392064 00000100:00100000:3.0:1788612883.329002:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932391936 00000100:00100000:3.0:1788612883.329005:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932391936 00000100:00100000:3.0:1788612883.329032:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932391168 00000100:00100000:3.0:1788612883.329036:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932391168 00000100:00100000:3.0:1788612883.329048:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932391808 00000100:00100000:3.0:1788612883.329052:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932391808 00000100:00100000:3.0:1788612883.329067:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788612883.329076:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932392064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612883.329144:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932392064:12345-0@lo:400:kworker.0 Request processed in 69us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612883.329152:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788612883.329167:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788612883.329172:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932391936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612883.329200:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875495932391936:12345-0@lo:400:kworker.0 Request processed in 27us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612883.329206:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788612883.329216:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788612883.329222:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932391168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612883.329345:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612883.329375:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932391680:0@lo:400:kworker.0 00000100:00100000:0.0:1788612883.329403:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612883.329415:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fd9aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932392192:0@lo:400:kworker.0 00000100:00100000:0.0:1788612883.329448:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612883.329499:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932391680 00000100:00100000:0.0:1788612883.329503:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932391680 00000100:00100000:0.0:1788612883.329520:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932392192 00000100:00100000:0.0:1788612883.329522:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932392192 00000100:00100000:0.0:1788612883.329536:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788612883.329543:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932391808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612883.329577:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932391808:12345-0@lo:400:kworker.0 Request processed in 34us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612883.329582:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788612883.329594:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788612883.329600:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932391680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612883.329631:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932391680:12345-0@lo:400:kworker.0 Request processed in 31us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612883.329637:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788612883.329651:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788612883.329657:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932392192:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788612883.330939:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788612883.330947:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788612883.330986:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612febbed80 x1875495932391808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612883.331001:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932391808:0@lo:400:kworker.0 00000100:00100000:1.0:1788612883.331537:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932391296 00000100:00100000:1.0:1788612883.331544:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932391296 00000100:00100000:1.0:1788612883.331586:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932390784 00000100:00100000:1.0:1788612883.331589:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932390784 00000100:00100000:1.0:1788612883.331605:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788612883.331613:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932391296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612883.331679:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932391296:12345-0@lo:400:kworker.0 Request processed in 67us (3992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612883.331686:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788612883.331700:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788612883.331705:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932390784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612883.331733:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932390784:12345-0@lo:400:kworker.0 Request processed in 27us (2387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612883.331749:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788612883.331768:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932390912 00000100:00100000:1.0:1788612883.331771:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932390912 00000100:00100000:1.0:1788612883.331791:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932391040 00000100:00100000:1.0:1788612883.331793:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932391040 00000100:00100000:1.0:1788612883.331800:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932391552 00000100:00100000:1.0:1788612883.331803:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932391552 00000100:00100000:1.0:1788612883.331812:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788612883.331816:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875495932390912:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788612883.331930:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932392192:12345-0@lo:400:kworker.0 Request processed in 2271us (2479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612883.331940:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788612883.332071:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fda18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932391296:0@lo:400:kworker.0 00010000:00080000:0.0:1788612883.332086:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612febbf480 x1875495932391936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612883.332095:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875495932391936:0@lo:400:kworker.0 00010000:00080000:0.0:1788612883.332107:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612febbc000 x1875495932392064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612883.332127:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932392064:0@lo:400:kworker.0 00000100:00100000:0.0:1788612883.332165:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fda1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932390784:0@lo:400:kworker.0 00010000:00080000:0.0:1788612883.332178:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612febbd180 x1875495932391680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612883.332187:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932391680:0@lo:400:kworker.0 00010000:00080000:0.0:1788612883.332197:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fd9aa680 x1875495932392192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612883.332204:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fd9aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932392192:0@lo:400:kworker.0 00000100:00100000:3.0:1788612883.332315:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875495932391168:12345-0@lo:400:kworker.0 Request processed in 3090us (4319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612883.332323:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788612883.332352:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788612883.332357:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875495932391040:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788612883.332382:0:24851:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 697 last 0 00000020:00000080:3.0:1788612883.332410:0:24851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc9cca 00002000:00100000:3.0:1788612883.332424:0:24851:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9611c8f1d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788612883.332428:0:24851:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788612883.332443:0:24851:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788612883.332626:0:24851:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788612883.332649:0:24851:0:(import.c:65:import_set_state_nolock()) ffff9611c8f19800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612883.332693:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1875495932391040:12345-0@lo:8:kworker.0 Request processed in 334us (4556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612883.332699:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788612883.332711:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788612883.332714:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875495932391552:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788612883.332727:0:24851:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 697 last 0 00000020:00000080:3.0:1788612883.332741:0:24851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1f8616bf0bc9cd1 00002000:00100000:3.0:1788612883.332746:0:24851:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9611c8f1f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788612883.332749:0:24851:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788612883.332750:0:24851:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788612883.332769:0:24851:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788612883.332779:0:24851:0:(import.c:65:import_set_state_nolock()) ffff9611c8f1b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612883.332803:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3647:x1875495932391552:12345-0@lo:8:kworker.0 Request processed in 88us (4629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612883.332809:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788612883.333415:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fda18380 x1875495932391040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788612908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788612883.333451:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788612883.333458:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788612883.333466:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788612883.333472:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788612883.333498:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612c82bb800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788612883.333515:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788612883.333520:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fda18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932391040:0@lo:8:kworker.0 00000004:00080000:2.0:1788612883.333560:0:22783:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1788612883.333579:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22783:1875495932392448:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788612883.333617:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612883.333638:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c78e20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612883.333657:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932392448 00000100:00100000:2.0:1788612883.333662:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932392448 00000100:00100000:2.0:1788612883.333699:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788612883.333707:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22783:x1875495932392448:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788612883.333939:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932392320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612883.333971:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788612883.334002:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fda19f80 x1875495932391168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612883.334011:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fda19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875495932391168:0@lo:400:kworker.0 00010000:00080000:1.0:1788612883.334096:0:24266:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 697 last 0 00000020:00000080:1.0:1788612883.334121:0:24266:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1f8616bf0bc9cd8 00002000:00100000:1.0:1788612883.334132:0:24266:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9611c8110000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788612883.334136:0:24266:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788612883.334138:0:24266:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788612883.334191:0:24266:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788612883.334209:0:24266:0:(import.c:65:import_set_state_nolock()) ffff9611c8115800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612883.334654:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932392320 00000100:00100000:3.0:1788612883.334661:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932392320 00000100:00100000:3.0:1788612883.334705:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788612883.334715:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875495932392320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612883.334754:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788612883.334802:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875495932392320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612883.334808:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612883.335814:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875495932390912:12345-0@lo:8:kworker.0 Request processed in 3992us (7722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612883.336141:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1788612883.336173:0:22782:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:3.0:1788612883.336402:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fc76e680 x1875495932392320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612883.336452:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932392320:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788612883.336945:0:22782:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697720467602ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788612883.336953:0:22782:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:2.0:1788612883.337695:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788612883.337737:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612febbc380 x1875495932391552/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788612908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788612883.337754:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788612883.337762:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788612883.337767:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788612883.337770:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9612e0943800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788612883.337785:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788612883.337791:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875495932391552:0@lo:8:kworker.0 00010000:00080000:2.0:1788612883.337815:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fda1a300 x1875495932390912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788612908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788612883.339158:0:23501:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788612883.339268:0:23501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 697722791245ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788612883.339277:0:23501:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1788612883.339792:0:23502:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788612883.340308:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc739c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1875495932392704:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788612883.340378:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612883.340410:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c7952cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612883.340984:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788612883.340995:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788612883.341005:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788612883.341011:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788612883.341014:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9611c80c2800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788612883.341027:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788612883.341034:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fda1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875495932390912:0@lo:8:kworker.0 00000004:00080000:2.0:1788612883.341246:0:22781:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:2.0:1788612883.341263:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22781:1875495932392960:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788612883.341303:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612883.341326:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9611c78e2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788612883.341343:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932392704 00000100:00100000:2.0:1788612883.341350:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932392704 00000100:00100000:2.0:1788612883.341392:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932392960 00000100:00100000:2.0:1788612883.341395:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932392960 00000100:00100000:2.0:1788612883.341412:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788612883.341420:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc73b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23502:x1875495932392704:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:2.0:1788612883.341501:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788612883.341504:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788612883.344812:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932392576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612883.344903:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612883.344947:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612883.344954:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932392832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612883.344977:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788612883.345027:0:22780:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788612883.345110:0:22780:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697728633588ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788612883.345117:0:22780:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788612883.345654:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932392576 00000100:00100000:2.0:1788612883.345663:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932392576 00000100:00100000:2.0:1788612883.345697:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932392832 00000100:00100000:2.0:1788612883.345700:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932392832 00000100:00100000:2.0:1788612883.345717:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788612883.345724:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc73a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875495932392576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788612883.345748:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788612883.345804:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc73a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875495932392576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612883.345818:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788612883.346474:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788612883.346505:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875495932392832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788612883.346527:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788612883.346572:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875495932392832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612883.346578:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00002000:00080000:1.0:1788612883.346769:0:24851:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788612883.346777:0:24851:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:1.0:1788612883.346782:0:24851:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00010000:00080000:0.0:1788612883.347767:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612c8ed0e00 x1875495932392832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612883.347791:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932392832:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788612883.347804:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fc738000 x1875495932392576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788612899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612883.347840:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932392576:0@lo:13:osp-pre-1-1.0 00002000:00080000:2.0:1788612883.357640:0:24264:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788612883.357653:0:24264:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788612883.357742:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc73b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23502:x1875495932392704:12345-0@lo:7:osp-pre-1-1.0 Request processed in 16318us (17360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612883.357752:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788612883.357782:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788612883.357793:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22781:x1875495932392960:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:0.0:1788612883.358315:0:23502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fc739c00 x1875495932392704/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788612899 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612883.358329:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc739c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1875495932392704:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788612883.358343:0:23502:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788612883.358383:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fd9aad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1875495932393088:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788612883.358424:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612883.358469:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612dad8b780 going to sleep for 11 seconds 00000004:00080000:0.0:1788612883.359223:0:23490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788612883.360501:0:24265:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788612883.360516:0:24265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1788612883.360623:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932393088 00000100:00100000:2.0:1788612883.360632:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932393088 00000100:00100000:2.0:1788612883.360764:0:25248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788612883.360775:0:25248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23502:x1875495932393088:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788612883.360804:0:25248:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1788612883.362260:0:25248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23502:x1875495932393088:12345-0@lo:5:osp-pre-1-1.0 Request processed in 1480us (3828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612883.362270:0:25248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788612883.364104:0:23502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fd9aad80 x1875495932393088/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788612899 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612883.364122:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fd9aad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1875495932393088:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788612883.364139:0:23502:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788612883.364191:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fd9aad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1875495932393216:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788612883.364241:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612883.364272:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fcf266c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612883.366959:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932393216 00000100:00100000:2.0:1788612883.366972:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932393216 00000100:00100000:2.0:1788612883.367021:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788612883.367039:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23502:x1875495932393216:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788612883.367079:0:24265:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00080000:0.0:1788612883.369706:0:24264:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788612883.369720:0:24264:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1788612883.369727:0:24264:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00002000:00010000:1.0:1788612883.383288:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.383300:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031f4735e/0x1f8616bf0bc9cdf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.383316:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.383320:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.383326:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031f4735e/0x1f8616bf0bc9cdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.383342:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031f4735e/0x1f8616bf0bc9cdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.383352:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031f4735e/0x1f8616bf0bc9cdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.383359:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031f4735e/0x1f8616bf0bc9cdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.383389:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788612883.383732:0:22736:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788612883.384118:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612883.384126:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031f4735e/0x1f8616bf0bc9cdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.384136:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d1e00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612883.384141:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031f4735e/0x1f8616bf0bc9cdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.384151:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031f4735e/0x1f8616bf0bc9cdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.384173:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031f4735e/0x1f8616bf0bc9cdf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.384181:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031f4735e/0x1f8616bf0bc9cdf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.384203:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.384205:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.384206:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612883.384525:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.384531:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf43f846/0x1f8616bf0bc9ce6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.384542:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.384551:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.384557:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf43f846/0x1f8616bf0bc9ce6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.384568:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf43f846/0x1f8616bf0bc9ce6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.384576:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf43f846/0x1f8616bf0bc9ce6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.384583:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf43f846/0x1f8616bf0bc9ce6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.384602:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612883.385034:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.385040:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc9ced lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385049:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.385053:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.385057:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc9ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385066:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc9ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385074:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc9ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385088:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc9ced lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385104:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788612883.385112:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788612883.385116:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf43f846/0x1f8616bf0bc9ce6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385122:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36e00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612883.385126:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf43f846/0x1f8616bf0bc9ce6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385133:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf43f846/0x1f8616bf0bc9ce6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385145:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf43f846/0x1f8616bf0bc9ce6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385153:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf43f846/0x1f8616bf0bc9ce6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385170:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612883.385173:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc9ced lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385189:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37600 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612883.385193:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc9ced lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385200:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc9ced lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385211:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc9ced lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385219:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4d0cc3f/0x1f8616bf0bc9ced lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385233:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.385235:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.385236:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612883.385609:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.385616:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9cf4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385626:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.385629:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.385633:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9cf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385643:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9cf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385660:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9cf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385667:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9cf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385680:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612883.385688:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612883.385691:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9cf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385697:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37400 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612883.385701:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9cf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385709:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9cf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385720:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9cf4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385728:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8fc7b94/0x1f8616bf0bc9cf4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.385741:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.385748:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.385750:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612883.386073:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.386080:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9cfb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386088:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.386091:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.386095:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386103:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386111:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386119:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386133:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612883.386141:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612883.386144:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386151:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36600 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612883.386155:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386174:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9cfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386185:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9cfb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386192:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9cfb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386206:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.386207:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.386209:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612883.386552:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.386558:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9d02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386567:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.386570:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.386575:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9d02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386584:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9d02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386593:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9d02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386606:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9d02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386620:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612883.386628:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612883.386632:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9d02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386638:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36c00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612883.386641:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9d02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386648:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9d02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386659:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9d02 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386667:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9d02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.386679:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.386681:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.386683:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.387039:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788612883.387962:0:22736:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788612883.390169:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.390193:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9d09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.390209:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.390213:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.390220:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9d09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.390235:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9d09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.390245:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9d09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.390253:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9d09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.390274:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788612883.390790:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612883.390798:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9d09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.390807:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612883.390811:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9d09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.390821:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9d09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.390911:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9d09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.390920:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7d388c8/0x1f8616bf0bc9d09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.390942:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612883.390944:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612883.390946:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612883.393031:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.393043:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9d10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.393059:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.393064:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.393070:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9d10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.393083:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9d10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.393093:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9d10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.393100:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9d10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.393116:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612883.393126:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612883.393131:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9d10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.393150:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240a00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612883.393154:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9d10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.393163:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9d10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.393179:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9d10 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.393187:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9d10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.393203:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.393205:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.393207:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612883.394223:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.394232:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e84bd445/0x1f8616bf0bc9d17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.394296:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.394299:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.394305:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e84bd445/0x1f8616bf0bc9d17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.394316:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e84bd445/0x1f8616bf0bc9d17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.394332:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e84bd445/0x1f8616bf0bc9d17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.394340:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e84bd445/0x1f8616bf0bc9d17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.394358:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612883.394975:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612883.394982:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e84bd445/0x1f8616bf0bc9d17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.394992:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241a00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612883.394996:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e84bd445/0x1f8616bf0bc9d17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.395006:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e84bd445/0x1f8616bf0bc9d17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.395030:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e84bd445/0x1f8616bf0bc9d17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.395037:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e84bd445/0x1f8616bf0bc9d17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.395057:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.395059:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.395061:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612883.396113:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.396122:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9d1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.396134:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.396137:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.396143:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9d1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.396154:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9d1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.396163:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9d1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.396171:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9d1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.396200:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612883.396210:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612883.396215:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9d1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.396223:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612883.396227:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9d1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.396235:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9d1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.396253:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9d1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.396261:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9d1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.396275:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.396276:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.396278:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612883.397221:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.397229:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae43d21c/0x1f8616bf0bc9d25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.398029:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.398041:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.398048:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae43d21c/0x1f8616bf0bc9d25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.398063:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae43d21c/0x1f8616bf0bc9d25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.398072:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae43d21c/0x1f8616bf0bc9d25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.398080:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae43d21c/0x1f8616bf0bc9d25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.398165:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612883.398176:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612883.398182:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae43d21c/0x1f8616bf0bc9d25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.398189:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612883.398193:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae43d21c/0x1f8616bf0bc9d25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.398202:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae43d21c/0x1f8616bf0bc9d25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.398217:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae43d21c/0x1f8616bf0bc9d25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.398224:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae43d21c/0x1f8616bf0bc9d25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.398264:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.398266:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.398268:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612883.399400:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.399408:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007caeb03d/0x1f8616bf0bc9d2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.399419:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.399422:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.399427:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007caeb03d/0x1f8616bf0bc9d2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.399449:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007caeb03d/0x1f8616bf0bc9d2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.399457:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007caeb03d/0x1f8616bf0bc9d2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.399464:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007caeb03d/0x1f8616bf0bc9d2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.399498:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788612883.400049:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612883.400057:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.400077:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788612883.400080:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612883.400084:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.400096:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.400103:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.400110:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.400127:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788612883.400137:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612883.400142:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007caeb03d/0x1f8616bf0bc9d2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.400149:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0031000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.400153:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007caeb03d/0x1f8616bf0bc9d2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.400161:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007caeb03d/0x1f8616bf0bc9d2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.400189:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007caeb03d/0x1f8616bf0bc9d2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.400197:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007caeb03d/0x1f8616bf0bc9d2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.400216:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612883.400220:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.400226:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.400229:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.400236:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.400246:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d33 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.400253:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.400265:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.400266:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.400274:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.401534:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612883.402172:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612883.402182:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9d3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.402196:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788612883.402200:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612883.402205:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9d3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.402218:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9d3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.402227:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9d3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.402234:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9d3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612883.402368:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.402375:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9d41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.402396:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.402399:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.402403:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9d41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.402412:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9d41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.402419:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9d41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.402426:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9d41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.402457:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612883.402801:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.402807:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bc02cd2/0x1f8616bf0bc9d48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.402815:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.402818:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.402821:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bc02cd2/0x1f8616bf0bc9d48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.402830:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bc02cd2/0x1f8616bf0bc9d48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.403286:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612883.403293:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9d41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.403301:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030200 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.403306:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9d41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.403314:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9d41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.403338:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9d41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.403345:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9d41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.403363:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.403365:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.403367:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.403386:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612883.403466:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bc02cd2/0x1f8616bf0bc9d48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.403473:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bc02cd2/0x1f8616bf0bc9d48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.403508:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788612883.403819:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612883.403826:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9d3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.403908:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3c00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612883.403914:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9d3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.403923:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9d3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.403938:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9d3a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.403957:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9d3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.403976:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612883.403979:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bc02cd2/0x1f8616bf0bc9d48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.403986:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0031a00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612883.403989:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bc02cd2/0x1f8616bf0bc9d48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.403996:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bc02cd2/0x1f8616bf0bc9d48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.404006:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bc02cd2/0x1f8616bf0bc9d48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.404013:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bc02cd2/0x1f8616bf0bc9d48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.404027:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.404028:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.404030:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612883.404357:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.404364:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc9d4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.404380:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.404383:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.404388:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc9d4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.404400:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc9d4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.404408:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc9d4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.404415:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc9d4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.404588:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612883.409032:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.409044:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9d56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.409061:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.409066:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.409072:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9d56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.409089:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9d56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.409100:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9d56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.409109:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9d56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.413521:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612883.413537:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc9d4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.413551:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240c00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.413557:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc9d4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.413568:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc9d4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.413590:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc9d4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.413598:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b0ef076/0x1f8616bf0bc9d4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.413633:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612883.413637:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9d56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.413643:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0031200 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.413647:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9d56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.413655:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9d56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.413666:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9d56 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.413674:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.413675:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.413677:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.413768:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612883.414383:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.414391:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000964c5829/0x1f8616bf0bc9d5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.414404:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.414408:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.414414:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000964c5829/0x1f8616bf0bc9d5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.414427:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000964c5829/0x1f8616bf0bc9d5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.414454:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000964c5829/0x1f8616bf0bc9d5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.414461:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000964c5829/0x1f8616bf0bc9d5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.414610:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612883.415182:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612883.415190:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000964c5829/0x1f8616bf0bc9d5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.415199:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240600 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.415204:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000964c5829/0x1f8616bf0bc9d5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.415225:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000964c5829/0x1f8616bf0bc9d5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.415238:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000964c5829/0x1f8616bf0bc9d5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.415256:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000964c5829/0x1f8616bf0bc9d5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.415275:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.415277:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.415279:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.415713:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612883.415720:0:24264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9d56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.416088:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612883.416819:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.416826:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000394e6531/0x1f8616bf0bc9d64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.416838:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.416842:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.416848:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000394e6531/0x1f8616bf0bc9d64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.416861:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000394e6531/0x1f8616bf0bc9d64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.416870:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000394e6531/0x1f8616bf0bc9d64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.416877:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000394e6531/0x1f8616bf0bc9d64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.416896:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612883.417219:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612883.417226:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000394e6531/0x1f8616bf0bc9d64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.417234:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030a00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.417244:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000394e6531/0x1f8616bf0bc9d64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.417254:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000394e6531/0x1f8616bf0bc9d64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.417268:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000394e6531/0x1f8616bf0bc9d64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.417287:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000394e6531/0x1f8616bf0bc9d64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.417305:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.417306:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.417308:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788612883.417524:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788612883.417530:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e248aef6/0x1f8616bf0bc9d6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.417539:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788612883.417547:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612883.417552:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e248aef6/0x1f8616bf0bc9d6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.417564:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e248aef6/0x1f8616bf0bc9d6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.417572:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e248aef6/0x1f8616bf0bc9d6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.417579:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e248aef6/0x1f8616bf0bc9d6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.417593:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612883.417821:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612883.417827:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e248aef6/0x1f8616bf0bc9d6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.417835:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612e81db600 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.417838:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e248aef6/0x1f8616bf0bc9d6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.417845:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e248aef6/0x1f8616bf0bc9d6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.417857:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e248aef6/0x1f8616bf0bc9d6b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.417864:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e248aef6/0x1f8616bf0bc9d6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.417879:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.417880:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.417882:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612883.418326:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612883.418333:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.418341:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788612883.418344:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612883.418348:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.418357:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.418365:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.418372:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.418388:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612883.418746:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612883.418753:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.418767:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612883.418772:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.418780:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.418794:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.418801:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa72c26f/0x1f8616bf0bc9d72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.418817:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.418819:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.418821:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612883.419178:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612883.419184:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc9d79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419194:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788612883.419197:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612883.419202:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc9d79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419222:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc9d79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419232:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc9d79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419251:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc9d79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419269:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788612883.419597:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612883.419604:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be540930/0x1f8616bf0bc9d80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419612:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788612883.419615:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612883.419619:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be540930/0x1f8616bf0bc9d80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419629:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be540930/0x1f8616bf0bc9d80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419636:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be540930/0x1f8616bf0bc9d80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419653:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be540930/0x1f8616bf0bc9d80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419669:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788612883.419678:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612883.419683:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc9d79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419690:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2a00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.419694:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc9d79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419703:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc9d79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419715:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc9d79 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419721:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e2bb645/0x1f8616bf0bc9d79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419735:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612883.419738:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be540930/0x1f8616bf0bc9d80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419756:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2200 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.419759:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be540930/0x1f8616bf0bc9d80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419767:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be540930/0x1f8616bf0bc9d80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419777:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be540930/0x1f8616bf0bc9d80 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419783:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be540930/0x1f8616bf0bc9d80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.419794:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.419796:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.419797:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612883.420090:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.420096:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9d87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.420105:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.420109:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.420113:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9d87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.420123:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9d87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.420137:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9d87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.420145:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9d87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.420161:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788612883.420467:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612883.420489:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9d87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.420497:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612883.420500:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9d87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.420509:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9d87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.420521:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9d87 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.420538:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9d87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.420555:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612883.420556:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612883.420558:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.420617:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612883.420693:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612883.420699:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ed10ff1/0x1f8616bf0bc9d8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.420707:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788612883.420710:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612883.420714:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed10ff1/0x1f8616bf0bc9d8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.420733:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed10ff1/0x1f8616bf0bc9d8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.420741:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ed10ff1/0x1f8616bf0bc9d8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.420747:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ed10ff1/0x1f8616bf0bc9d8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612883.421023:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.421029:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9d95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.421038:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.421040:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.421044:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9d95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.421052:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9d95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.421059:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9d95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.421066:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9d95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.421269:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788612883.421748:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612883.421754:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbc3c9c1/0x1f8616bf0bc9d9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.421763:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788612883.421766:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612883.421770:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbc3c9c1/0x1f8616bf0bc9d9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.421778:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbc3c9c1/0x1f8616bf0bc9d9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.421786:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbc3c9c1/0x1f8616bf0bc9d9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.421803:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbc3c9c1/0x1f8616bf0bc9d9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.422037:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788612883.422045:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ed10ff1/0x1f8616bf0bc9d8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.422053:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3e00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612883.422058:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ed10ff1/0x1f8616bf0bc9d8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.422067:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ed10ff1/0x1f8616bf0bc9d8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.422081:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ed10ff1/0x1f8616bf0bc9d8e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.422091:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed10ff1/0x1f8616bf0bc9d8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.422104:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612883.422107:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9d95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.422119:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030e00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612883.422122:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9d95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.422129:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9d95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.422139:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9d95 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.422147:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612883.422150:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbc3c9c1/0x1f8616bf0bc9d9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.422155:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2e00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612883.422158:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbc3c9c1/0x1f8616bf0bc9d9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.422164:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbc3c9c1/0x1f8616bf0bc9d9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.422172:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbc3c9c1/0x1f8616bf0bc9d9c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.422179:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612883.422186:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612883.422187:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.422413:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788612883.422419:0:24264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9d95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.422789:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612883.423679:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.423689:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9da3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.423702:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.423707:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.423713:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9da3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.423725:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9da3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.423735:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9da3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.423743:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9da3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.423774:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788612883.424116:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.424122:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9daa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424130:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.424133:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.424136:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9daa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424145:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9daa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424152:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9daa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424158:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9daa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424172:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788612883.424180:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612883.424185:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9da3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424191:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612883.424201:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9da3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424209:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9da3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424222:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9da3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424229:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9da3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424258:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612883.424262:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9daa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424270:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240a00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612883.424272:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9daa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424280:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9daa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424290:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9daa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424296:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9daa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424315:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.424317:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.424319:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612883.424661:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.424666:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9db1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424675:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.424678:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.424682:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9db1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424692:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9db1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424699:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9db1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424706:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9db1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424718:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612883.424725:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612883.424729:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9db1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424746:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241200 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612883.424749:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9db1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424757:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9db1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424768:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9db1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424774:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9db1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.424788:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.424789:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.424791:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.425077:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.425493:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788612883.425502:0:24851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbc3c9c1/0x1f8616bf0bc9d9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.426846:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612883.429271:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.429284:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9db8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.429301:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.429306:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.429312:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9db8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.429326:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9db8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.429336:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9db8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.429344:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9db8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.429371:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612883.430058:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.430075:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9dbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.430084:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.430088:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.430092:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9dbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.430102:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9dbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.430110:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9dbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.430117:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9dbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.430134:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788612883.430145:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788612883.430150:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9db8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.430157:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0031200 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612883.430162:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9db8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.430171:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9db8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.430195:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9db8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.430203:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9db8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.430223:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612883.430226:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9dbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.430233:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0031800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612883.430236:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9dbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.430256:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9dbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.430265:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9dbf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.430273:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9dbf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.430284:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.430286:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.430293:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.430732:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612883.430831:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.430838:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c912ae04/0x1f8616bf0bc9dc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.430849:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.430852:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.430856:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c912ae04/0x1f8616bf0bc9dc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.430879:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c912ae04/0x1f8616bf0bc9dc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.430888:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c912ae04/0x1f8616bf0bc9dc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.430895:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c912ae04/0x1f8616bf0bc9dc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.430918:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612883.431404:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.431411:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9dcd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.431420:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.431424:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.431428:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9dcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.431450:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9dcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.431458:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9dcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.431466:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9dcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.431497:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788612883.431809:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612883.431817:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c912ae04/0x1f8616bf0bc9dc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.431826:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240200 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.431831:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c912ae04/0x1f8616bf0bc9dc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.431839:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c912ae04/0x1f8616bf0bc9dc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.431854:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c912ae04/0x1f8616bf0bc9dc6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.431861:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c912ae04/0x1f8616bf0bc9dc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.431893:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612883.431897:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9dcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.431904:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.431907:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9dcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.431915:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9dcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.431924:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9dcd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.431931:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9dcd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.431946:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.431948:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.431949:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.431956:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612883.432375:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612883.432381:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9dd4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.432390:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788612883.432399:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612883.432404:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.432414:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.432423:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.432440:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.432464:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788612883.432769:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612883.432774:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.432783:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612883.432786:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.432806:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9dd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.432818:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9dd4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.432825:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb1f3cb8/0x1f8616bf0bc9dd4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.432842:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.432843:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.432845:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612883.432942:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.432948:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc9ddb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.432956:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.432959:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.432963:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc9ddb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.432973:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc9ddb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.432980:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc9ddb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.432995:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc9ddb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.433016:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:2.0:1788612883.433378:0:25079:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1788612883.433414:0:25079:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788612883.433420:0:25079:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788612883.434372:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612883.434381:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc9ddb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.434392:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241400 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.434396:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc9ddb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.434406:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc9ddb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.434421:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc9ddb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.434453:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f998cfca/0x1f8616bf0bc9ddb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.434492:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.434494:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.434496:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612883.434561:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612883.434567:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2ef306/0x1f8616bf0bc9de2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.434578:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788612883.434582:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612883.434587:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d2ef306/0x1f8616bf0bc9de2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.434598:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d2ef306/0x1f8616bf0bc9de2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.434606:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2ef306/0x1f8616bf0bc9de2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.434614:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d2ef306/0x1f8616bf0bc9de2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.434630:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612883.434638:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612883.434649:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d2ef306/0x1f8616bf0bc9de2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.434656:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.434659:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2ef306/0x1f8616bf0bc9de2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.434665:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2ef306/0x1f8616bf0bc9de2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.434676:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d2ef306/0x1f8616bf0bc9de2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.434683:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d2ef306/0x1f8616bf0bc9de2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.434697:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.434699:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.434700:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612883.435058:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23502:x1875495932393216:12345-0@lo:5:osp-pre-1-1.0 Request processed in 68018us (70813us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788612883.435068:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788612883.436622:0:23502:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788612883.436636:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fd9aad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1875495932393216:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788612883.436652:0:23502:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1788612883.436704:0:23502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fd9aad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23502:1875495932393344:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788612883.436749:0:23502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612883.436782:0:23502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e08e16c0 going to sleep for 11 seconds 00002000:00010000:0.0:1788612883.436864:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612883.436879:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bc9de9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.436904:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788612883.436909:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612883.436914:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bc9de9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.436927:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bc9de9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.436938:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bc9de9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.436945:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bc9de9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.436963:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612883.436974:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612883.436979:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bc9de9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.436986:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2400 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.436990:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bc9de9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.436999:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bc9de9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.437021:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bc9de9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.437029:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bc9de9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.437048:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.437050:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.437052:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612883.437772:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612883.437780:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036870f8f/0x1f8616bf0bc9df0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.437792:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788612883.437795:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612883.437800:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036870f8f/0x1f8616bf0bc9df0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.437813:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036870f8f/0x1f8616bf0bc9df0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.437821:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036870f8f/0x1f8616bf0bc9df0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.437828:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036870f8f/0x1f8616bf0bc9df0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.437855:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612883.437865:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612883.437869:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036870f8f/0x1f8616bf0bc9df0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.437876:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3400 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.437879:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036870f8f/0x1f8616bf0bc9df0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.437902:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036870f8f/0x1f8616bf0bc9df0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.437916:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036870f8f/0x1f8616bf0bc9df0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.437923:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036870f8f/0x1f8616bf0bc9df0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.437939:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.437940:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.437942:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788612883.438736:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612883.438743:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9df7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.438754:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788612883.438764:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612883.438769:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9df7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.438779:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9df7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.438788:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9df7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.438795:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9df7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.438856:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788612883.439036:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612883.439042:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f01a4e3/0x1f8616bf0bc9dfe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.439051:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788612883.439054:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612883.439058:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f01a4e3/0x1f8616bf0bc9dfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.439068:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f01a4e3/0x1f8616bf0bc9dfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.439075:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f01a4e3/0x1f8616bf0bc9dfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.439089:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f01a4e3/0x1f8616bf0bc9dfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612883.439198:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932393344 00000100:00100000:1.0:1788612883.439206:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932393344 00000100:00100000:1.0:1788612883.439261:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612883.439271:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23502:x1875495932393344:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788612883.439354:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23502:x1875495932393344:12345-0@lo:900:osp-pre-1-1.0 Request processed in 85us (2604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612883.439361:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788612883.440973:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612883.440985:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9df7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.440997:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3c00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612883.441002:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9df7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.441012:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9df7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.441029:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9df7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.441036:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012bdbef1/0x1f8616bf0bc9df7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.441056:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612883.441060:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f01a4e3/0x1f8616bf0bc9dfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.441066:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896200 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612883.441069:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f01a4e3/0x1f8616bf0bc9dfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.441088:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f01a4e3/0x1f8616bf0bc9dfe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.441098:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f01a4e3/0x1f8616bf0bc9dfe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.441105:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612883.441107:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612883.441109:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788612883.441969:0:23502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fd9aad80 x1875495932393344/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788612899 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612883.441985:0:23502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fd9aad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23502:1875495932393344:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1788612883.445323:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.445403:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788612883.445414:0:24851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f01a4e3/0x1f8616bf0bc9dfe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788612883.445954:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.445962:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc9e05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.445975:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.445979:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.445985:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc9e05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.446007:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc9e05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.446032:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc9e05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.446040:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc9e05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788612883.446280:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788612883.446286:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bfe839f/0x1f8616bf0bc9e0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.446294:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788612883.446297:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612883.446301:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bfe839f/0x1f8616bf0bc9e0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.446311:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bfe839f/0x1f8616bf0bc9e0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.446318:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bfe839f/0x1f8616bf0bc9e0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.446324:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bfe839f/0x1f8616bf0bc9e0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.446360:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788612883.446939:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.446946:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf074d2/0x1f8616bf0bc9e13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.446956:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.446960:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.446965:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adf074d2/0x1f8616bf0bc9e13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.446975:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adf074d2/0x1f8616bf0bc9e13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.446983:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf074d2/0x1f8616bf0bc9e13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.447003:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adf074d2/0x1f8616bf0bc9e13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.447174:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788612883.447183:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc9e05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.447192:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241600 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612883.447196:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc9e05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.447206:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc9e05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.447236:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc9e05 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.447255:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079646bf3/0x1f8616bf0bc9e05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.447271:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788612883.447275:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bfe839f/0x1f8616bf0bc9e0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.447281:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612883.447284:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bfe839f/0x1f8616bf0bc9e0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.447291:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bfe839f/0x1f8616bf0bc9e0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.447301:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bfe839f/0x1f8616bf0bc9e0c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.447309:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788612883.447312:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adf074d2/0x1f8616bf0bc9e13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.447318:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241e00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612883.447327:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf074d2/0x1f8616bf0bc9e13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.447336:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf074d2/0x1f8616bf0bc9e13 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.447346:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adf074d2/0x1f8616bf0bc9e13 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.447355:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.447356:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612883.447358:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.451353:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788612883.451367:0:24851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bfe839f/0x1f8616bf0bc9e0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.452344:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788612883.452353:0:24264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adf074d2/0x1f8616bf0bc9e13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.452403:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.452894:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612883.453961:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.453971:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9e1a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.453985:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.453989:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.453995:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9e1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.454009:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9e1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.454029:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9e1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.454036:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9e1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.454064:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612883.454075:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612883.454081:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9e1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.454088:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241200 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612883.454092:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9e1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.454102:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9e1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.454116:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9e1a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.454123:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081709827/0x1f8616bf0bc9e1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.454140:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.454141:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.454143:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612883.454598:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.454605:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9e21 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.454614:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.454624:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.454628:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9e21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.454637:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9e21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.454644:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9e21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.454652:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9e21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.454669:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788612883.455186:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.455193:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9e2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.455202:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.455205:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.455210:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9e2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.455220:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9e2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.455229:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9e2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.455455:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612883.455462:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9e21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.455470:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240a00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.455487:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9e21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.455496:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9e21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.455509:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9e21 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.455517:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef4c6a88/0x1f8616bf0bc9e21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.455531:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.455533:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.455535:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.455986:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9e2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.456005:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612883.456083:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612883.456088:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9e2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.456096:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612883.456099:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9e2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.456107:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9e2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.456119:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9e2f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.456127:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2b1432b/0x1f8616bf0bc9e2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.456140:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.456142:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.456144:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612883.457349:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.457367:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009546c42a/0x1f8616bf0bc9e36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.457380:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.457384:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.457389:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009546c42a/0x1f8616bf0bc9e36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.457401:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009546c42a/0x1f8616bf0bc9e36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.457409:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009546c42a/0x1f8616bf0bc9e36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.457416:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009546c42a/0x1f8616bf0bc9e36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.457451:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788612883.457724:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788612883.457735:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ad97c79/0x1f8616bf0bc9e28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.457743:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788612883.457746:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612883.457750:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ad97c79/0x1f8616bf0bc9e28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.457760:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ad97c79/0x1f8616bf0bc9e28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.457768:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ad97c79/0x1f8616bf0bc9e28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.457775:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ad97c79/0x1f8616bf0bc9e28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.457805:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788612883.458237:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788612883.458254:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000749530c3/0x1f8616bf0bc9e3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.458264:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788612883.458267:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612883.458272:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000749530c3/0x1f8616bf0bc9e3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.458281:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000749530c3/0x1f8616bf0bc9e3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.458289:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000749530c3/0x1f8616bf0bc9e3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.458296:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000749530c3/0x1f8616bf0bc9e3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.458304:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788612883.458678:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788612883.458685:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e248aef6/0x1f8616bf0bc9e44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.458693:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788612883.458703:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612883.458708:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e248aef6/0x1f8616bf0bc9e44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.458718:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e248aef6/0x1f8616bf0bc9e44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.458726:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e248aef6/0x1f8616bf0bc9e44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.458733:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e248aef6/0x1f8616bf0bc9e44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.458742:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788612883.459327:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788612883.459336:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009546c42a/0x1f8616bf0bc9e36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459346:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.459350:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009546c42a/0x1f8616bf0bc9e36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459359:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009546c42a/0x1f8616bf0bc9e36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459375:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009546c42a/0x1f8616bf0bc9e36 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459383:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009546c42a/0x1f8616bf0bc9e36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459402:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788612883.459406:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ad97c79/0x1f8616bf0bc9e28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459411:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612e81db800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.459414:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ad97c79/0x1f8616bf0bc9e28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459423:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ad97c79/0x1f8616bf0bc9e28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459461:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ad97c79/0x1f8616bf0bc9e28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459468:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ad97c79/0x1f8616bf0bc9e28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459496:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612883.459500:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000749530c3/0x1f8616bf0bc9e3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459505:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612e81dbe00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.459509:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000749530c3/0x1f8616bf0bc9e3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459516:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000749530c3/0x1f8616bf0bc9e3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459525:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000749530c3/0x1f8616bf0bc9e3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459532:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000749530c3/0x1f8616bf0bc9e3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459543:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612883.459546:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e248aef6/0x1f8616bf0bc9e44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459559:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612e81db600 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.459562:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e248aef6/0x1f8616bf0bc9e44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459569:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e248aef6/0x1f8616bf0bc9e44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459579:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e248aef6/0x1f8616bf0bc9e44 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459585:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e248aef6/0x1f8616bf0bc9e44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.459597:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.459599:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.459600:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.460109:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612883.460176:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.460184:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc9e4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.460194:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.460198:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.460204:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc9e4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.460227:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc9e4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.460235:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc9e4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788612883.460380:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788612883.460386:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9e52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.460394:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788612883.460396:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612883.460401:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9e52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.460410:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9e52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.460417:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9e52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.460441:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9e52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.460464:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612883.460754:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc9e4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.460768:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788612883.460777:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788612883.460781:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9e52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.460789:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36c00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612883.460792:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9e52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.460801:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9e52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.460814:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9e52 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.460822:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cfa8081/0x1f8616bf0bc9e52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.460844:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612883.460847:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc9e4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.460853:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240e00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612883.460856:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc9e4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.460864:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc9e4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.460872:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc9e4b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.460879:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de0ab67c/0x1f8616bf0bc9e4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.462192:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.462194:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.462196:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788612883.462816:0:24851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788612883.462824:0:24851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9e59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.462838:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1788612883.462842:0:24851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788612883.462847:0:24851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9e59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.462860:0:24851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9e59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.462869:0:24851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9e59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.462876:0:24851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9e59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612883.462906:0:24851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612883.463419:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612883.463427:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9e59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.463447:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36600 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612883.463461:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9e59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.463471:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9e59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.463501:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9e59 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.463508:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006b154b8/0x1f8616bf0bc9e59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.463525:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.463526:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.463528:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788612883.463576:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788612883.463581:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc9e60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.463590:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1788612883.463593:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788612883.463598:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc9e60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.463607:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc9e60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.463615:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc9e60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.463627:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc9e60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.463639:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788612883.463646:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788612883.463650:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc9e60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.463656:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:1.0:1788612883.463659:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc9e60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.463665:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc9e60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.463675:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc9e60 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.463681:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca9a01fa/0x1f8616bf0bc9e60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612883.463694:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.463696:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612883.463697:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.463967:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788612883.466005:0:24851:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1788612883.466109:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22783:x1875495932392448:12345-0@lo:5:osp-pre-1-0.0 Request processed in 132398us (132486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612883.466128:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788612883.467356:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22783:1875495932392448:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788612883.467381:0:22783:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1788612883.467423:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc73aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22783:1875495932393472:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788612883.467507:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612883.467531:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c82843c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788612883.467730:0:25248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932393472 00000100:00100000:2.0:1788612883.467738:0:25248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932393472 00000100:00100000:2.0:1788612883.467783:0:25248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788612883.467793:0:25248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc739500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:22783:x1875495932393472:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788612883.467828:0:25248:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:2.0:1788612883.484029:0:25248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc739500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:22783:x1875495932393472:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16229us (16513us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788612883.484042:0:25248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00002000:00010000:2.0:1788612883.484150:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.484159:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9e67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.484175:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.484180:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.484187:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9e67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.484214:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9e67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.484225:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9e67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.484232:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.484258:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788612883.484840:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.484846:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9e6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.484855:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.484858:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.484862:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9e6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.484870:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9e6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.484878:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9e6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.484908:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9e6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.484928:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788612883.485282:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.485288:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9e75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.485297:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.485300:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.485304:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9e75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.485313:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9e75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.485321:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9e75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.485328:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9e75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.485337:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788612883.485652:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.485658:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9e7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.485672:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.485675:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.485679:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9e7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.485688:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9e7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.485698:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9e7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.485707:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.485716:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1788612883.486074:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc73aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22783:1875495932393472:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788612883.486092:0:22783:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00002000:00010000:2.0:1788612883.486359:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.486367:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000394e6531/0x1f8616bf0bc9e83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.486377:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.486380:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.486385:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000394e6531/0x1f8616bf0bc9e83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.486395:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000394e6531/0x1f8616bf0bc9e83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.486416:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000394e6531/0x1f8616bf0bc9e83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.486422:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000394e6531/0x1f8616bf0bc9e83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.486443:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1788612883.486817:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788612883.486825:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.486833:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0031800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.486837:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.486846:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9e67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.486869:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9e67 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.486877:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000919421e/0x1f8616bf0bc9e67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.486974:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788612883.486978:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9e6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.486986:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0031200 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.486988:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9e6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.486995:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9e6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.487005:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9e6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.487011:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e37b206c/0x1f8616bf0bc9e6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.487023:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788612883.487027:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9e75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.487039:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030e00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.487042:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9e75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.487050:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9e75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.487060:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9e75 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.487068:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000441eabea/0x1f8616bf0bc9e75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.487080:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788612883.487083:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.487090:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.487093:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.487100:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9e7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.487108:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9e7c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.487121:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048697d9a/0x1f8616bf0bc9e7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.487132:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612883.487136:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000394e6531/0x1f8616bf0bc9e83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.487142:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030a00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.487145:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000394e6531/0x1f8616bf0bc9e83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.487153:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000394e6531/0x1f8616bf0bc9e83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.487163:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000394e6531/0x1f8616bf0bc9e83 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.487169:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000394e6531/0x1f8616bf0bc9e83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.487181:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.487182:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.487184:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.487191:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612883.488060:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.488069:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9e8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.488080:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.488083:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.488088:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9e8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.488100:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9e8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.488109:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9e8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.488117:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9e8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.488153:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612883.488563:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612883.488570:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9e8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.488584:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030800 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.488588:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9e8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.488597:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9e8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.488610:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9e8a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.488618:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068802405/0x1f8616bf0bc9e8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.488635:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.488637:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.488638:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788612883.490404:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788612883.490416:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9e91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.490443:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1788612883.490448:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612883.490453:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9e91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.490467:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9e91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.491774:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9e91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.491791:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9e91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612883.491809:0:24264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788612883.492349:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788612883.492357:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9e91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.492366:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030200 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:0.0:1788612883.492372:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9e91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.492382:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9e91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.492417:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9e91 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.492425:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbe04ad8/0x1f8616bf0bc9e91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612883.492465:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.492467:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788612883.492468:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788612883.492995:0:24264:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:2.0:1788612883.493096:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22781:x1875495932392960:12345-0@lo:5:osp-pre-0-0.0 Request processed in 135302us (151788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612883.493106:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612883.494949:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22781:1875495932392960:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788612883.494969:0:22781:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:0.0:1788612883.495034:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fd9abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22781:1875495932393600:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788612883.495091:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612883.495131:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea34180 going to sleep for 11 seconds 00000100:00100000:2.0:1788612883.497692:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932393600 00000100:00100000:2.0:1788612883.497717:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932393600 00000100:00100000:2.0:1788612883.497768:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788612883.497778:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22781:x1875495932393600:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788612883.497826:0:24265:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:0.0:1788612883.519398:0:24260:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1788612883.519462:0:24260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788612883.522196:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22781:x1875495932393600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 24412us (27097us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788612883.522210:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788612883.522442:0:22781:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1788612883.522452:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fd9abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22781:1875495932393600:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788612883.522467:0:22781:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000040:00080000:2.0:1788612883.764514:0:23512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788612883.826366:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788612884.850031:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612885.871850:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612886.015222:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612886.015244:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932393728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788612886.015311:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612886.015360:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932393728 00000100:00100000:3.0:1788612886.015366:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932393728 00000100:00100000:3.0:1788612886.015431:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788612886.015442:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932393728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788612886.015470:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788612886.015533:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932393728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612886.015541:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788612886.015562:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612886.015600:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932393728:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788612886.902349:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612887.023834:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788612887.023861:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fd9abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932393856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612887.023928:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612887.023992:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932393856 00000100:00100000:3.0:1788612887.024001:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932393856 00000100:00100000:3.0:1788612887.024088:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788612887.024098:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932393856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788612887.024130:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788612887.024202:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932393856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612887.024209:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788612887.024503:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fd9abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932393856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612887.024551:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612887.024559:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc738700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932393984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612887.024586:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612887.024737:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932393984 00000100:00100000:3.0:1788612887.024742:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932393984 00000100:00100000:3.0:1788612887.024776:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788612887.024783:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc73bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932393984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788612887.024801:0:22762:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788612887.024843:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc73bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932393984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612887.024850:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788612887.024883:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc738700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932393984:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788612887.690030:0:25436:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788612887.925978:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612888.559727:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932394496:0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.559807:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612888.559854:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932395008:0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.559880:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612888.559898:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932395520:0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.559924:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612888.559949:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788612888.559955:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6b44f55-8b88-4406-a946-d178714afb91:3650:1875495932394112:0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.559981:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612888.560004:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc76e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932394624:0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.560033:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612888.560047:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932395136:0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.560065:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612888.560079:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932395648:0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.560111:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612888.560136:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932394368:0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.560157:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612888.560174:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932394880:0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.560192:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612888.560207:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932395392:0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.560226:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612888.560239:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788612888.560243:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932394240:0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.560263:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612888.560278:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932394752:0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.560299:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612888.560318:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932395264:0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.560348:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612888.560363:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932395776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612888.560377:0:25248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932394496 00000100:00100000:3.0:1788612888.560385:0:25248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932394496 00000100:00100000:1.0:1788612888.560410:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612888.560449:0:25248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932395008 00000100:00100000:3.0:1788612888.560453:0:25248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932395008 00000100:00100000:3.0:1788612888.560494:0:25248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932394368 00000100:00100000:3.0:1788612888.560497:0:25248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932394368 00000100:00100000:1.0:1788612888.560500:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932394240 00000100:00100000:1.0:1788612888.560506:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932394240 00000100:00100000:3.0:1788612888.560512:0:25248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932394880 00000100:00100000:3.0:1788612888.560517:0:25248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932394880 00000100:00100000:3.0:1788612888.560540:0:25248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612888.560544:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932394752 00000100:00100000:1.0:1788612888.560549:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932394752 00000100:00100000:3.0:1788612888.560551:0:25248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932394496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612888.560568:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788612888.560577:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932394240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.560612:0:25248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932394496:12345-0@lo:400:kworker.0 Request processed in 63us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612888.560619:0:25248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788612888.560632:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932394240:12345-0@lo:400:kworker.0 Request processed in 56us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612888.560640:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788612888.560648:0:25248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788612888.560659:0:25248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932395008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612888.560663:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788612888.560673:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932394752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.560701:0:25248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932395008:12345-0@lo:400:kworker.0 Request processed in 45us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612888.560709:0:25248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788612888.560718:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932394752:12345-0@lo:400:kworker.0 Request processed in 46us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612888.560727:0:25248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788612888.560739:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788612888.560740:0:25248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932394368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612888.560769:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932395776 00000100:00100000:1.0:1788612888.560773:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932395776 00000100:00100000:3.0:1788612888.560778:0:25248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932394368:12345-0@lo:400:kworker.0 Request processed in 42us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612888.560787:0:25248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788612888.560805:0:25248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788612888.560809:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612888.560814:0:25248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932394880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612888.560821:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc73b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875495932395776:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612888.560846:0:25248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932394880:12345-0@lo:400:kworker.0 Request processed in 34us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612888.560853:0:25248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00002000:00000024:1.0:1788612888.560862:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788612888.560879:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932394112 00000100:00100000:3.0:1788612888.560885:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932394112 00000100:00100000:1.0:1788612888.560910:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc73b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875495932395776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612888.560917:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788612888.560922:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788612888.560927:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+24:3650:x1875495932394112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.560964:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+24:3650:x1875495932394112:12345-0@lo:400:kworker.0 Request processed in 41us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612888.560971:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788612888.560977:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932395776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612888.561002:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932395520 00000100:00100000:3.0:1788612888.561006:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932395520 00000100:00100000:1.0:1788612888.561014:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932394240:0@lo:400:kworker.0 00000100:00100000:1.0:1788612888.561029:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932394752:0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.561030:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932394624 00000100:00100000:3.0:1788612888.561034:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932394624 00000100:00100000:1.0:1788612888.561047:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932394368:0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.561048:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932395136 00000100:00100000:3.0:1788612888.561057:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932395136 00000100:00100000:1.0:1788612888.561061:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932394880:0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.561073:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932395648 00000100:00100000:3.0:1788612888.561076:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932395648 00000100:00100000:3.0:1788612888.561093:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932395392 00000100:00100000:3.0:1788612888.561095:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932395392 00000100:00100000:3.0:1788612888.561106:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932395264 00000100:00100000:3.0:1788612888.561108:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932395264 00000100:00100000:3.0:1788612888.561120:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788612888.561125:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932395520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.561153:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932395520:12345-0@lo:400:kworker.0 Request processed in 27us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612888.561159:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788612888.561168:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788612888.561173:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932394624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.561194:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932394624:12345-0@lo:400:kworker.0 Request processed in 21us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612888.561199:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788612888.561208:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788612888.561213:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932395136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.561235:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932395136:12345-0@lo:400:kworker.0 Request processed in 23us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612888.561241:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788612888.561251:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788612888.561256:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932395648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.561281:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932395648:12345-0@lo:400:kworker.0 Request processed in 25us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612888.561286:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788612888.561307:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788612888.561313:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932395392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.561351:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932395392:12345-0@lo:400:kworker.0 Request processed in 38us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612888.561357:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788612888.561368:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788612888.561374:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932395264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.561413:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932395264:12345-0@lo:400:kworker.0 Request processed in 39us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612888.561420:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788612888.561447:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788612888.561452:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788612888.561454:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788612888.561456:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612888.561494:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6b44f55-8b88-4406-a946-d178714afb91:3650:1875495932394112:0@lo:400:kworker.0 00010000:00080000:3.0:1788612888.561507:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fc76e680 x1875495932394624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612888.561517:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932394624:0@lo:400:kworker.0 00010000:00080000:3.0:1788612888.561525:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c80edf80 x1875495932395136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612888.561533:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932395136:0@lo:400:kworker.0 00010000:00080000:3.0:1788612888.561540:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c80ec000 x1875495932395648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612888.561547:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932395648:0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.561565:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc76f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932394496:0@lo:400:kworker.0 00000100:00100000:3.0:1788612888.561573:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932395008:0@lo:400:kworker.0 00010000:00080000:3.0:1788612888.561581:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c80edc00 x1875495932395520/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612888.561587:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932395520:0@lo:400:kworker.0 00000100:00100000:0.0:1788612888.561947:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612888.561964:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fd9a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932395904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612888.561997:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612888.562040:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932395904 00000100:00100000:0.0:1788612888.562045:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932395904 00000100:00100000:0.0:1788612888.562071:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788612888.562078:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932395904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788612888.562095:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788612888.562125:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932395904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612888.562131:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788612888.562160:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fd9a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932395904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612888.564658:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612888.564679:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932396032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612888.564739:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788612888.564806:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c80ece00 x1875495932395264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612888.564821:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932395264:0@lo:400:kworker.0 00010000:00080000:1.0:1788612888.564833:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c80eed80 x1875495932395392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612888.564841:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932395392:0@lo:400:kworker.0 00000100:00100000:2.0:1788612888.565707:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932396032 00000100:00100000:2.0:1788612888.565717:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932396032 00000100:00100000:2.0:1788612888.565773:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788612888.565784:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932396032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788612888.565807:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788612888.565866:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932396032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612888.565874:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788612888.565972:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932396032:0@lo:13:osp-pre-1-1.0 00000020:00000004:0.0:1788612888.741961:0:25488:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788612888.742722:0:25488:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788612888.945654:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788612889.594876:0:25079:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000020:00000004:0.0:1788612889.740018:0:25538:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788612889.740231:0:25538:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788612889.968769:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612890.053680:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612890.053927:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914454912 00000100:00100000:2.0:1788612890.053937:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914454912 00000100:00100000:2.0:1788612890.053988:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 114 00000100:00100000:2.0:1788612890.053998:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2393:x1875495914454912:12345-192.168.203.30@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788612890.054025:0:22748:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a495520c-d9bc-4ce5-bb68-b6caa50213a1@192.168.203.30@tcp t0 exp 0000000000000000 cur 704 last 0 00000020:00000080:2.0:1788612890.054052:0:22748:0:(genops.c:1385:class_connect()) connect: client a495520c-d9bc-4ce5-bb68-b6caa50213a1, cookie 0x1f8616bf0bc9e98 00000100:00080000:2.0:1788612890.054181:0:22748:0:(import.c:65:import_set_state_nolock()) ffff9611c10b8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788612890.054242:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+5:2393:x1875495914454912:12345-192.168.203.30@tcp:250:mount.lustre.0 Request processed in 244us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612890.054250:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 114 00000100:00100000:0.0:1788612890.072948:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612890.081239:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914455040 00000100:00100000:3.0:1788612890.081254:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914455040 00000100:00100000:3.0:1788612890.081309:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:3.0:1788612890.081319:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+5:18059:x1875495914455040:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788612890.081335:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612890.081352:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612f7b37400/0x1f8616bf0bc9e9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d226cf expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612890.081379:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612f7b37400/0x1f8616bf0bc9e9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226cf expref: 6 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612890.081401:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612f7b37400/0x1f8616bf0bc9e9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226cf expref: 6 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612890.081410:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b37400, rc 0) 00000100:00100000:3.0:1788612890.081471:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+6:18059:x1875495914455040:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 153us (8532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612890.081500:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:3.0:1788612890.101347:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612890.101400:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914455168 00000100:00100000:3.0:1788612890.101415:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914455168 00000100:00100000:3.0:1788612890.101467:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:3.0:1788612890.101494:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+6:18059:x1875495914455168:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788612890.101617:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+6:18059:x1875495914455168:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 140us (278us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788612890.101626:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:1.0:1788612890.113103:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612890.114186:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914455296 00000100:00100000:0.0:1788612890.114198:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914455296 00000100:00100000:0.0:1788612890.114248:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:0.0:1788612890.114259:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+6:18059:x1875495914455296:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788612890.114276:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612890.114293:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc9ea6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d226d6 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612890.114322:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc9ea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226d6 expref: 7 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612890.114334:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c2896000/0x1f8616bf0bc9ea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d226d6 expref: 7 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612890.114350:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2896000, rc 0) 00000100:00100000:0.0:1788612890.114418:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+7:18059:x1875495914455296:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 160us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612890.114439:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:3.0:1788612890.121812:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612890.121922:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914455424 00000100:00100000:1.0:1788612890.121931:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914455424 00000100:00100000:1.0:1788612890.121987:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:1.0:1788612890.121997:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c73ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+7:18059:x1875495914455424:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788612890.122164:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c73ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+8:18059:x1875495914455424:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 167us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612890.122172:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:0.0:1788612890.130524:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612890.130738:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914455552 00000100:00100000:3.0:1788612890.130748:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914455552 00000100:00100000:3.0:1788612890.130805:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 119 00000100:00100000:3.0:1788612890.130815:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c73efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+8:18059:x1875495914455552:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788612890.130963:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c73efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+8:18059:x1875495914455552:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 149us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612890.130971:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 119 00000100:00100000:3.0:1788612890.136913:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612890.137117:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914455680 00000100:00100000:0.0:1788612890.137127:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914455680 00000100:00100000:0.0:1788612890.137188:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:0.0:1788612890.137199:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c73edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+8:18077:x1875495914455680:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788612890.137353:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c73edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+8:18077:x1875495914455680:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 154us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612890.137361:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:3.0:1788612890.181057:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612890.181261:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914455808 00000100:00100000:0.0:1788612890.181271:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914455808 00000100:00100000:0.0:1788612890.181326:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 121 00000100:00100000:0.0:1788612890.181335:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c73ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+8:18077:x1875495914455808:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788612890.181532:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c73ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+8:18077:x1875495914455808:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 197us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612890.181541:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 121 00000100:00100000:3.0:1788612890.205131:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612890.205560:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914455936 00000100:00100000:0.0:1788612890.205689:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914455936 00000100:00100000:0.0:1788612890.205764:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00100000:0.0:1788612890.205775:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c73ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+8:18077:x1875495914455936:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788612890.206142:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c73ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+8:18077:x1875495914455936:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 368us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612890.206157:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00100000:3.0:1788612890.222913:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612890.223082:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914456064 00000100:00100000:0.0:1788612890.223093:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914456064 00000100:00100000:0.0:1788612890.223150:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:0.0:1788612890.223161:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c73ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+8:18059:x1875495914456064:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788612890.223177:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612890.223195:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc9ead lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22707 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612890.223224:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc9ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22707 expref: 9 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612890.223236:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c2896a00/0x1f8616bf0bc9ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22707 expref: 9 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612890.223253:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2896a00, rc 0) 00000100:00100000:0.0:1788612890.223313:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c73ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+9:18059:x1875495914456064:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 154us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612890.223321:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:3.0:1788612890.227295:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612890.228398:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914456192 00000100:00100000:0.0:1788612890.228410:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914456192 00000100:00100000:0.0:1788612890.228470:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:0.0:1788612890.228519:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c73ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+9:18059:x1875495914456192:12345-192.168.203.30@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788612890.228543:0:22748:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788612890.228564:0:22748:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788612890.228568:0:22748:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788612890.228580:0:22748:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788612890.228589:0:22748:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788612890.228591:0:22748:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788612890.231181:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c73ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+9:18059:x1875495914456192:12345-192.168.203.30@tcp:256:mount.lustre.0 Request processed in 2654us (3885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612890.231196:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:1.0:1788612890.245817:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612890.245979:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914456320 00000100:00100000:2.0:1788612890.245999:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914456320 00000100:00100000:2.0:1788612890.246090:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:2.0:1788612890.246100:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c73ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+9:18059:x1875495914456320:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788612890.246114:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612890.246129:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c0031800/0x1f8616bf0bc9eb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2270e expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612890.246165:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c0031800/0x1f8616bf0bc9eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2270e expref: 10 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612890.246176:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c0031800/0x1f8616bf0bc9eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2270e expref: 10 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612890.246185:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0031800, rc 0) 00000100:00100000:2.0:1788612890.246238:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c73ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+10:18059:x1875495914456320:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 139us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612890.246244:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:3.0:1788612890.249984:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612890.250124:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914456448 00000100:00100000:0.0:1788612890.250134:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914456448 00000100:00100000:0.0:1788612890.250202:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:0.0:1788612890.250213:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c73ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+10:18059:x1875495914456448:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788612890.250367:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c73ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+10:18059:x1875495914456448:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 155us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612890.250659:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:0.0:1788612890.259873:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612890.260026:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914456576 00000100:00100000:2.0:1788612890.260037:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914456576 00000100:00100000:2.0:1788612890.260094:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00100000:2.0:1788612890.260104:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c13ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+10:18059:x1875495914456576:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788612890.260411:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c13ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+10:18059:x1875495914456576:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 307us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612890.260420:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00100000:1.0:1788612890.268059:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612890.268152:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914456704 00000100:00100000:0.0:1788612890.268162:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914456704 00000100:00100000:0.0:1788612890.268211:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:0.0:1788612890.268222:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+10:18082:x1875495914456704:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788612890.268397:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+10:18082:x1875495914456704:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 176us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612890.268405:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:3.0:1788612890.276798:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612890.278690:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914456832 00000100:00100000:2.0:1788612890.278706:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914456832 00000100:00100000:2.0:1788612890.278779:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:2.0:1788612890.278790:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+10:18082:x1875495914456832:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788612890.278962:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+10:18082:x1875495914456832:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 173us (2173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612890.278971:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:0.0:1788612890.309723:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612890.309839:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914456960 00000100:00100000:3.0:1788612890.309849:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914456960 00000100:00100000:3.0:1788612890.309903:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:3.0:1788612890.309911:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2393:x1875495914456960:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788612890.309944:0:24230:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from cca74f02-70d3-462b-9a97-5f7e9e5ea7bf@192.168.203.30@tcp t0 exp 0000000000000000 cur 704 last 0 00000020:00000080:3.0:1788612890.310010:0:24230:0:(genops.c:1385:class_connect()) connect: client cca74f02-70d3-462b-9a97-5f7e9e5ea7bf, cookie 0x1f8616bf0bc9ebb 00000004:00100000:3.0:1788612890.310037:0:24230:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1788612890.310289:0:24230:0:(import.c:65:import_set_state_nolock()) ffff9611c75dd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612890.310373:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:2393:x1875495914456960:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 461us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612890.310389:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:1.0:1788612890.312180:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612890.312268:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914457216 00000100:00100000:0.0:1788612890.312276:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914457216 00000100:00100000:0.0:1788612890.312332:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:0.0:1788612890.312341:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1875495914457216:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788612890.312369:0:22758:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from cca74f02-70d3-462b-9a97-5f7e9e5ea7bf@192.168.203.30@tcp t0 exp 0000000000000000 cur 704 last 0 00000020:00000080:0.0:1788612890.312441:0:22758:0:(genops.c:1385:class_connect()) connect: client cca74f02-70d3-462b-9a97-5f7e9e5ea7bf, cookie 0x1f8616bf0bc9ec2 00000004:00100000:0.0:1788612890.312461:0:22758:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:0.0:1788612890.312698:0:22758:0:(import.c:65:import_set_state_nolock()) ffff9612fcad6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612890.312768:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:2393:x1875495914457216:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 426us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612890.312776:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:1.0:1788612890.315257:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612890.315350:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914457088 00000100:00100000:3.0:1788612890.315359:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914457088 00000100:00100000:3.0:1788612890.315438:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:3.0:1788612890.315448:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:0:x1875495914457088:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788612890.315523:0:24230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788612890.315597:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:0:x1875495914457088:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 150us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612890.315604:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00080000:0.0:1788612890.317232:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612890.320921:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612890.320964:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612890.321096:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914457472 00000100:00100000:0.0:1788612890.321106:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914457472 00000100:00100000:0.0:1788612890.321164:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914457344 00000100:00100000:0.0:1788612890.321168:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914457344 00000100:00100000:0.0:1788612890.321210:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1788612890.321220:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:18059:x1875495914457472:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788612890.321249:0:22758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788612890.321312:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:18059:x1875495914457472:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 93us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612890.321502:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:1.0:1788612890.321576:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:0:x1875495914457344:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788612890.321600:0:22756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788612890.321643:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:0:x1875495914457344:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 71us (679us total) trans 0 rc 0/0 00000100:00080000:3.0:1788612890.330064:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788612890.335030:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612890.335178:0:24230:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788612890.335198:0:24230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788612890.335518:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914457600 00000100:00100000:2.0:1788612890.335528:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914457600 00000100:00100000:3.0:1788612890.335755:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:3.0:1788612890.335767:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+7:18059:x1875495914457600:12345-192.168.203.30@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788612890.335871:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+7:18059:x1875495914457600:12345-192.168.203.30@tcp:40:mount.lustre.0 Request processed in 106us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612890.335879:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:1.0:1788612890.340755:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:0.0:1788612890.341150:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:1.0:1788612890.346739:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612890.346795:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612890.346865:0:25248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914457728 00000100:00100000:3.0:1788612890.346873:0:25248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914457728 00000100:00100000:3.0:1788612890.346912:0:25248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914457856 00000100:00100000:3.0:1788612890.346914:0:25248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914457856 00000100:00100000:3.0:1788612890.346936:0:25248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:3.0:1788612890.346950:0:25248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc73b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2393:x1875495914457728:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788612890.346982:0:25248:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from cca74f02-70d3-462b-9a97-5f7e9e5ea7bf@192.168.203.30@tcp t0 exp 0000000000000000 cur 704 last 0 00000020:00000080:3.0:1788612890.347009:0:25248:0:(genops.c:1385:class_connect()) connect: client cca74f02-70d3-462b-9a97-5f7e9e5ea7bf, cookie 0x1f8616bf0bc9ec9 00002000:00100000:3.0:1788612890.347018:0:25248:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cca74f02-70d3-462b-9a97-5f7e9e5ea7bf/ffff9611c75dc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788612890.347035:0:25248:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:3.0:1788612890.347189:0:25248:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788612890.347230:0:25248:0:(import.c:65:import_set_state_nolock()) ffff9611c75da000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612890.347287:0:25248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc73b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:2393:x1875495914457728:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 337us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612890.347295:0:25248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:3.0:1788612890.347314:0:25248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:3.0:1788612890.347319:0:25248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2393:x1875495914457856:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788612890.347335:0:25248:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from cca74f02-70d3-462b-9a97-5f7e9e5ea7bf@192.168.203.30@tcp t0 exp 0000000000000000 cur 704 last 0 00000020:00000080:3.0:1788612890.347360:0:25248:0:(genops.c:1385:class_connect()) connect: client cca74f02-70d3-462b-9a97-5f7e9e5ea7bf, cookie 0x1f8616bf0bc9ed0 00002000:00100000:3.0:1788612890.347365:0:25248:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cca74f02-70d3-462b-9a97-5f7e9e5ea7bf/ffff9611c75df800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788612890.347376:0:25248:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1788612890.347517:0:25248:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788612890.347533:0:25248:0:(import.c:65:import_set_state_nolock()) ffff9611c75de000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788612890.347557:0:25248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:2393:x1875495914457856:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 236us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612890.347562:0:25248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:1.0:1788612890.350587:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612890.350667:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914457984 00000100:00100000:0.0:1788612890.350676:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914457984 00000100:00100000:0.0:1788612890.350747:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:0.0:1788612890.350758:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:18059:x1875495914457984:12345-192.168.203.30@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788612890.350842:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:18059:x1875495914457984:12345-192.168.203.30@tcp:900:mount.lustre.0 Request processed in 86us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612890.350847:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000001:00100000:2.0:1788612890.352782:0:24260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cca74f02-70d3-462b-9a97-5f7e9e5ea7bf 00000100:00100000:2.0:1788612890.354692:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000040:00080000:0.0:1788612890.356912:0:22790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788612890.357997:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914458112 00000100:00100000:2.0:1788612890.358008:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914458112 00000100:00100000:2.0:1788612890.358068:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:2.0:1788612890.358078:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:18059:x1875495914458112:12345-192.168.203.30@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788612890.359744:0:22759:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1572us 00000004:00200000:3.0:1788612890.377496:0:22759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788612890.377653:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:18059:x1875495914458112:12345-192.168.203.30@tcp:33:mount.lustre.0 Request processed in 19570us (22964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612890.377669:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:3.0:1788612890.598611:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612890.598839:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914458240 00000100:00100000:2.0:1788612890.598850:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914458240 00000100:00100000:2.0:1788612890.598915:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:2.0:1788612890.598926:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:18105:x1875495914458240:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:2.0:1788612890.598945:0:24230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612890.598970:0:24230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc9ed7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2273f expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612890.599035:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc9ede lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612890.599049:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc9ede lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612890.599065:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc9ede lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612890.599237:0:24230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788612890.599241:0:24230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788612890.599292:0:24230:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc9ede lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612890.599319:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030800/0x1f8616bf0bc9ed7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2273f expref: 8 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612890.599339:0:24230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc9ede lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2273f expref: 7 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612890.599348:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7800) 00010000:00010000:2.0:1788612890.599351:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612890.599355:0:24230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0030200, rc 0) 00000100:00100000:2.0:1788612890.599427:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+7:18105:x1875495914458240:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 503us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612890.599435:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00010000:00010000:1.0:1788612890.991772:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612891.119846:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788612891.119870:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612e901dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932396160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612891.119943:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612891.120094:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932396160 00000100:00100000:0.0:1788612891.120112:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932396160 00000100:00100000:0.0:1788612891.120176:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788612891.120186:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932396160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788612891.120206:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00080000:3.0:1788612891.120304:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612891.120343:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932396160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 159us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612891.120350:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788612891.123740:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612e901dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932396160:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788612892.015674:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612892.144898:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fd9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932396288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788612892.144982:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612892.145063:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932396288 00000100:00100000:0.0:1788612892.145071:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932396288 00000100:00100000:0.0:1788612892.145122:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788612892.145131:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932396288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788612892.145163:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788612892.145257:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932396416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612892.145291:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612892.145343:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932396416 00000100:00100000:2.0:1788612892.145347:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932396416 00000100:00100000:2.0:1788612892.145382:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788612892.145403:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932396416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788612892.145423:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788612892.145457:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932396416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612892.145464:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788612892.145540:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932396416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788612892.161791:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932396288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 16641us (16789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612892.161805:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788612892.173407:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fd9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932396288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612892.498704:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612892.503155:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914458368 00000100:00100000:3.0:1788612892.503330:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914458368 00000100:00100000:3.0:1788612892.503464:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:3.0:1788612892.503488:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+7:18157:x1875495914458368:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:3.0:1788612892.503524:0:25550:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788612892.503618:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+7:18157:x1875495914458368:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 145us (4924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612892.503625:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00080000:0.0:1788612892.503986:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788612892.510809:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612892.512050:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914458496 00000100:00100000:2.0:1788612892.512061:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914458496 00000100:00100000:2.0:1788612892.512269:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:2.0:1788612892.512280:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:18157:x1875495914458496:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:2.0:1788612892.512320:0:22758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788612892.512428:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:18157:x1875495914458496:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 149us (1752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612892.512436:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00080000:0.0:1788612892.513129:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788612892.519435:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612892.519640:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914458624 00000100:00100000:0.0:1788612892.519651:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914458624 00000100:00100000:0.0:1788612892.519731:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1788612892.519747:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:18157:x1875495914458624:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:0.0:1788612892.519777:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788612892.519859:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:18157:x1875495914458624:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 119us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612892.519866:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00080000:3.0:1788612892.519932:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612892.523827:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612892.524336:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914458752 00000100:00100000:0.0:1788612892.524359:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914458752 00000100:00100000:0.0:1788612892.524441:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:0.0:1788612892.524452:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:18157:x1875495914458752:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:0.0:1788612892.524512:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1788612892.524653:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612892.526351:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:18157:x1875495914458752:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 1890us (2522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612892.526362:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:2.0:1788612892.682094:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612892.682538:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914458880 00000100:00100000:0.0:1788612892.682549:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914458880 00000100:00100000:0.0:1788612892.682613:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:0.0:1788612892.682623:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+10:18187:x1875495914458880:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788612892.682639:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612892.682657:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c2896400/0x1f8616bf0bc9ee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22746 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612892.682684:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c2896400/0x1f8616bf0bc9ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22746 expref: 11 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612892.682695:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c2896400/0x1f8616bf0bc9ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22746 expref: 11 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612892.682703:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2896400, rc 0) 00000100:00100000:0.0:1788612892.682775:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+11:18187:x1875495914458880:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 154us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612892.682782:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:2.0:1788612892.698083:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612892.698170:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914459008 00000100:00100000:3.0:1788612892.698189:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914459008 00000100:00100000:3.0:1788612892.698252:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:3.0:1788612892.698262:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+11:18187:x1875495914459008:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788612892.698433:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+11:18187:x1875495914459008:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 171us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612892.698456:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:3.0:1788612892.701964:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612892.704355:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914459136 00000100:00100000:2.0:1788612892.704378:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914459136 00000100:00100000:2.0:1788612892.704451:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:2.0:1788612892.704462:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+11:18187:x1875495914459136:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788612892.704654:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+11:18187:x1875495914459136:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 193us (2697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612892.704662:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:2.0:1788612892.717044:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612892.717748:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914459264 00000100:00100000:0.0:1788612892.717759:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914459264 00000100:00100000:2.0:1788612892.717956:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:2.0:1788612892.717969:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+11:18194:x1875495914459264:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788612892.718122:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+11:18194:x1875495914459264:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 156us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612892.718130:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:0.0:1788612892.754661:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612892.754775:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914459392 00000100:00100000:3.0:1788612892.754786:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914459392 00000100:00100000:3.0:1788612892.754845:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:3.0:1788612892.754855:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+11:18194:x1875495914459392:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788612892.755017:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+11:18194:x1875495914459392:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 163us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612892.755025:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:3.0:1788612892.762034:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612892.770046:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914459520 00000100:00100000:0.0:1788612892.770066:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914459520 00000100:00100000:0.0:1788612892.770167:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:0.0:1788612892.770190:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612cf0e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+11:18194:x1875495914459520:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788612892.770417:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612cf0e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+11:18194:x1875495914459520:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 229us (8657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612892.770431:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:0.0:1788612892.784336:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612892.784427:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914459648 00000100:00100000:2.0:1788612892.784437:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914459648 00000100:00100000:2.0:1788612892.784521:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:2.0:1788612892.784532:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+11:18187:x1875495914459648:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788612892.784549:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612892.784566:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc9eec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22777 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612892.784593:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc9eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22777 expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612892.784604:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c0030800/0x1f8616bf0bc9eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22777 expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612892.784614:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0030800, rc 0) 00000100:00100000:2.0:1788612892.784669:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+12:18187:x1875495914459648:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 138us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612892.784675:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:2.0:1788612892.791847:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612892.792019:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914459776 00000100:00100000:3.0:1788612892.792030:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914459776 00000100:00100000:3.0:1788612892.792086:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:3.0:1788612892.792095:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+12:18187:x1875495914459776:12345-192.168.203.30@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788612892.792117:0:22750:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788612892.792152:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788612892.792156:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788612892.792159:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788612892.792161:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788612892.792163:0:22750:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788612892.794299:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+12:18187:x1875495914459776:12345-192.168.203.30@tcp:256:mount.lustre.0 Request processed in 2196us (2452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612892.794314:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:0.0:1788612892.799425:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612892.800086:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914459904 00000100:00100000:2.0:1788612892.800095:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914459904 00000100:00100000:2.0:1788612892.800206:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 138 00000100:00100000:2.0:1788612892.800216:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+12:18187:x1875495914459904:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788612892.800232:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612892.800250:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c0030000/0x1f8616bf0bc9ef3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2277e expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612892.800276:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c0030000/0x1f8616bf0bc9ef3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2277e expref: 13 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612892.800288:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c0030000/0x1f8616bf0bc9ef3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2277e expref: 13 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612892.800297:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0030000, rc 0) 00000100:00100000:2.0:1788612892.800357:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+13:18187:x1875495914459904:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 141us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612892.800373:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 138 00000100:00100000:2.0:1788612892.802589:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612892.802696:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914460032 00000100:00100000:0.0:1788612892.802705:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914460032 00000100:00100000:0.0:1788612892.802893:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 139 00000100:00100000:0.0:1788612892.802904:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+13:18187:x1875495914460032:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788612892.803062:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+13:18187:x1875495914460032:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 159us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612892.803069:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 139 00000100:00100000:3.0:1788612892.805818:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612892.806145:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914460160 00000100:00100000:2.0:1788612892.806155:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914460160 00000100:00100000:2.0:1788612892.806222:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:2.0:1788612892.806232:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+13:18187:x1875495914460160:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788612892.806390:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+13:18187:x1875495914460160:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 158us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612892.806398:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:2.0:1788612892.810042:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612892.810355:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914460288 00000100:00100000:0.0:1788612892.810372:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914460288 00000100:00100000:0.0:1788612892.810613:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 141 00000100:00100000:0.0:1788612892.810625:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+13:18201:x1875495914460288:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788612892.810769:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+13:18201:x1875495914460288:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 146us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612892.810787:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 141 00000100:00100000:1.0:1788612892.819252:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612892.822123:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914460416 00000100:00100000:2.0:1788612892.822139:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914460416 00000100:00100000:2.0:1788612892.822530:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:2.0:1788612892.822544:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+13:18201:x1875495914460416:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788612892.822803:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+13:18201:x1875495914460416:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 261us (3559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612892.822811:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:3.0:1788612892.829740:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612892.829840:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612892.829926:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914460544 00000100:00100000:0.0:1788612892.829936:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914460544 00000100:00100000:0.0:1788612892.829980:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914460800 00000100:00100000:0.0:1788612892.829984:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914460800 00000100:00100000:0.0:1788612892.830014:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:0.0:1788612892.830022:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2393:x1875495914460544:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788612892.830052:0:25550:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 85c43ba8-70ea-4b49-9ede-8fbb9c68d254@192.168.203.30@tcp t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:0.0:1788612892.830088:0:25550:0:(genops.c:1385:class_connect()) connect: client 85c43ba8-70ea-4b49-9ede-8fbb9c68d254, cookie 0x1f8616bf0bc9efa 00000004:00100000:0.0:1788612892.830113:0:25550:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1788612892.830267:0:25550:0:(import.c:65:import_set_state_nolock()) ffff9612fcad5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612892.830329:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:2393:x1875495914460544:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 307us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612892.830336:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:0.0:1788612892.830355:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:0.0:1788612892.830359:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2393:x1875495914460800:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788612892.830386:0:25550:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 85c43ba8-70ea-4b49-9ede-8fbb9c68d254@192.168.203.30@tcp t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:0.0:1788612892.830410:0:25550:0:(genops.c:1385:class_connect()) connect: client 85c43ba8-70ea-4b49-9ede-8fbb9c68d254, cookie 0x1f8616bf0bc9f01 00000004:00100000:0.0:1788612892.830423:0:25550:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:0.0:1788612892.830464:0:25550:0:(import.c:65:import_set_state_nolock()) ffff9612fcad1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788612892.830517:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:2393:x1875495914460800:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 155us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612892.830524:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:1.0:1788612892.833460:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612892.833525:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612892.833557:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612892.833641:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914461056 00000100:00100000:2.0:1788612892.833651:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914461056 00000100:00100000:2.0:1788612892.833719:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914460928 00000100:00100000:2.0:1788612892.833723:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914460928 00000100:00100000:2.0:1788612892.833740:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914460672 00000100:00100000:2.0:1788612892.833743:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914460672 00000100:00100000:2.0:1788612892.833767:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:2.0:1788612892.833778:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+7:18187:x1875495914461056:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788612892.833814:0:22758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788612892.833878:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+7:18187:x1875495914461056:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 102us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612892.833885:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:2.0:1788612892.833903:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:2.0:1788612892.833910:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:0:x1875495914460928:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788612892.833926:0:22758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788612892.833954:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:0:x1875495914460928:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 45us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612892.833961:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:2.0:1788612892.833975:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1788612892.833982:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:0:x1875495914460672:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788612892.834011:0:22758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788612892.834034:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:0:x1875495914460672:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 52us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612892.834040:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00080000:1.0:1788612892.834262:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788612892.834266:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612892.839903:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612892.840307:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914461184 00000100:00100000:2.0:1788612892.840316:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914461184 00000100:00100000:2.0:1788612892.840381:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:2.0:1788612892.840391:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:18187:x1875495914461184:12345-192.168.203.30@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788612892.840509:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:18187:x1875495914461184:12345-192.168.203.30@tcp:40:mount.lustre.0 Request processed in 87us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612892.840516:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:3.0:1788612892.845325:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612892.845361:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612892.845402:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612892.845507:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914461568 00000100:00100000:0.0:1788612892.845516:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914461568 00000100:00100000:0.0:1788612892.845563:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:0.0:1788612892.845572:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e901dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:18187:x1875495914461568:12345-192.168.203.30@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788612892.845644:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e901dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:18187:x1875495914461568:12345-192.168.203.30@tcp:900:mount.lustre.0 Request processed in 73us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612892.845651:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:1.0:1788612892.845744:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914461312 00000100:00100000:1.0:1788612892.845749:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914461312 00000100:00100000:1.0:1788612892.845785:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914461440 00000100:00100000:1.0:1788612892.845788:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914461440 00000100:00100000:1.0:1788612892.845808:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:1.0:1788612892.845813:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2393:x1875495914461312:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788612892.845838:0:24265:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 85c43ba8-70ea-4b49-9ede-8fbb9c68d254@192.168.203.30@tcp t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:1.0:1788612892.845863:0:24265:0:(genops.c:1385:class_connect()) connect: client 85c43ba8-70ea-4b49-9ede-8fbb9c68d254, cookie 0x1f8616bf0bc9f08 00002000:00100000:1.0:1788612892.845874:0:24265:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 85c43ba8-70ea-4b49-9ede-8fbb9c68d254/ffff9611c8117800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788612892.845883:0:24265:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788612892.845955:0:24265:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788612892.845982:0:24265:0:(import.c:65:import_set_state_nolock()) ffff9611c8117000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612892.846011:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:2393:x1875495914461312:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 196us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612892.846018:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:1.0:1788612892.846031:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:1.0:1788612892.846036:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc76e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2393:x1875495914461440:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788612892.846410:0:24265:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 85c43ba8-70ea-4b49-9ede-8fbb9c68d254@192.168.203.30@tcp t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:1.0:1788612892.846426:0:24265:0:(genops.c:1385:class_connect()) connect: client 85c43ba8-70ea-4b49-9ede-8fbb9c68d254, cookie 0x1f8616bf0bc9f0f 00002000:00100000:1.0:1788612892.846431:0:24265:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 85c43ba8-70ea-4b49-9ede-8fbb9c68d254/ffff9611c8111000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788612892.846437:0:24265:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788612892.846469:0:24265:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788612892.846519:0:24265:0:(import.c:65:import_set_state_nolock()) ffff9611c8111800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788612892.846546:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc76e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:2393:x1875495914461440:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 508us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612892.846553:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:3.0:1788612892.848966:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612892.849129:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914461696 00000100:00100000:1.0:1788612892.849138:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914461696 00000100:00100000:1.0:1788612892.849355:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:1.0:1788612892.849376:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:18187:x1875495914461696:12345-192.168.203.30@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788612892.849464:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788612892.849600:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:18187:x1875495914461696:12345-192.168.203.30@tcp:33:mount.lustre.0 Request processed in 236us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612892.849608:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:1.0:1788612892.991308:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612892.991437:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914461824 00000100:00100000:3.0:1788612892.991446:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914461824 00000100:00100000:3.0:1788612892.991534:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:3.0:1788612892.991544:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:18224:x1875495914461824:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:3.0:1788612892.991563:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612892.991585:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc9f16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d227af expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612892.991644:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc9f1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612892.991658:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc9f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612892.991671:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc9f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612892.991713:0:22757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788612892.991717:0:22757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788612892.991971:0:22757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc9f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612892.991999:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc9f16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227af expref: 8 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612892.992019:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc9f1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227af expref: 7 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612892.992027:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7800) 00010000:00010000:3.0:1788612892.992044:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612892.992047:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36e00, rc 0) 00000100:00100000:3.0:1788612892.992150:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+7:18224:x1875495914461824:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 607us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612892.992158:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00010000:00010000:1.0:1788612893.040582:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612893.679818:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932396544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612893.679891:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612893.679953:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612893.679959:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932396672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612893.679983:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612893.680018:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932396544 00000100:00100000:1.0:1788612893.680037:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932396544 00000100:00100000:1.0:1788612893.680087:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932396672 00000100:00100000:1.0:1788612893.680091:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932396672 00000100:00100000:1.0:1788612893.680108:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788612893.680115:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932396544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788612893.680142:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788612893.680186:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932396544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612893.680193:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788612893.680210:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788612893.680216:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932396672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612893.680231:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788612893.680258:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932396672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612893.680264:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788612893.680280:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612893.680283:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612893.680304:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788612893.680325:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932396672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612893.680338:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932396544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612893.680458:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788612893.680467:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fd9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932396800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612893.680515:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612893.681841:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fd9aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6b44f55-8b88-4406-a946-d178714afb91:3649:1875495932396928:0@lo:400:kworker.0 00000100:00100000:0.0:1788612893.681890:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612893.681919:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932397440:0@lo:400:kworker.0 00000100:00100000:0.0:1788612893.681945:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612893.681961:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fda18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932397952:0@lo:400:kworker.0 00000100:00100000:0.0:1788612893.681983:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612893.682004:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788612893.682010:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932397312:0@lo:400:kworker.0 00000100:00100000:0.0:1788612893.682032:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612893.682051:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fda1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932397824:0@lo:400:kworker.0 00000100:00100000:0.0:1788612893.682101:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612893.682134:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932396928 00000100:00100000:0.0:1788612893.682139:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932396928 00000100:00100000:0.0:1788612893.682178:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788612893.682186:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+24:3649:x1875495932396928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612893.682227:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+24:3649:x1875495932396928:12345-0@lo:400:kworker.0 Request processed in 41us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612893.682245:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788612893.682276:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932397952 00000100:00100000:0.0:1788612893.682280:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932397952 00000100:00100000:0.0:1788612893.682307:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932397824 00000100:00100000:0.0:1788612893.682310:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932397824 00000100:00100000:0.0:1788612893.682330:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788612893.682336:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fda18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932397952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612893.682381:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fda18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875495932397952:12345-0@lo:400:kworker.0 Request processed in 45us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612893.682387:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788612893.682399:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788612893.682405:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961300f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932397824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612893.682444:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961300f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932397824:12345-0@lo:400:kworker.0 Request processed in 39us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612893.682449:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788612893.682466:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932397312 00000100:00100000:0.0:1788612893.682470:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932397312 00000100:00100000:0.0:1788612893.682513:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788612893.682519:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fda19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932397312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612893.682549:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fda19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932397312:12345-0@lo:400:kworker.0 Request processed in 30us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612893.682555:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788612893.682593:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932397312:0@lo:400:kworker.0 00010000:00080000:0.0:1788612893.682604:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fda1a300 x1875495932397824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612893.682613:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fda1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932397824:0@lo:400:kworker.0 00000100:00100000:0.0:1788612893.682629:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fd9aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6b44f55-8b88-4406-a946-d178714afb91:3649:1875495932396928:0@lo:400:kworker.0 00000100:00100000:0.0:1788612893.682639:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fda18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875495932397952:0@lo:400:kworker.0 00000100:00100000:1.0:1788612893.682750:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932397440 00000100:00100000:1.0:1788612893.682755:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932397440 00000100:00100000:1.0:1788612893.682781:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788612893.682787:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fda1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932397440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612893.682824:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fda1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932397440:12345-0@lo:400:kworker.0 Request processed in 37us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612893.682842:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788612893.683015:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932397184:0@lo:400:kworker.0 00000100:00100000:1.0:1788612893.683043:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612893.683066:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932397696:0@lo:400:kworker.0 00000100:00100000:1.0:1788612893.683086:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612893.683102:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788612893.683109:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932397056:0@lo:400:kworker.0 00000100:00100000:1.0:1788612893.683132:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612893.683147:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612febbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932397568:0@lo:400:kworker.0 00000100:00100000:1.0:1788612893.683166:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612893.683180:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fda19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932398080:0@lo:400:kworker.0 00000100:00100000:1.0:1788612893.683202:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612893.683226:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932397184 00000100:00100000:1.0:1788612893.683230:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932397184 00000100:00100000:1.0:1788612893.683255:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932397696 00000100:00100000:1.0:1788612893.683258:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932397696 00000100:00100000:1.0:1788612893.683271:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932397568 00000100:00100000:1.0:1788612893.683273:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932397568 00000100:00100000:1.0:1788612893.683284:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932398080 00000100:00100000:1.0:1788612893.683287:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932398080 00000100:00100000:1.0:1788612893.683300:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788612893.683306:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932397184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612893.683341:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875495932397184:12345-0@lo:400:kworker.0 Request processed in 35us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612893.683347:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788612893.683372:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788612893.683386:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c80edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932397696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612893.683417:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c80edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875495932397696:12345-0@lo:400:kworker.0 Request processed in 32us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612893.683422:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788612893.683433:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788612893.683439:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932397568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612893.683464:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932397568:12345-0@lo:400:kworker.0 Request processed in 26us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612893.683470:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788612893.683501:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788612893.683507:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932398080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612893.683534:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932398080:12345-0@lo:400:kworker.0 Request processed in 27us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612893.683539:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1788612893.683556:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788612893.683560:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788612893.683562:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612893.683691:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932397568:0@lo:400:kworker.0 00010000:00080000:1.0:1788612893.683702:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fda19f80 x1875495932398080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612893.683712:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fda19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932398080:0@lo:400:kworker.0 00000100:00100000:1.0:1788612893.683722:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875495932397184:0@lo:400:kworker.0 00000100:00100000:1.0:1788612893.683730:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875495932397696:0@lo:400:kworker.0 00000100:00100000:3.0:1788612893.683731:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932396800 00000100:00100000:3.0:1788612893.683735:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932396800 00000100:00080000:1.0:1788612893.683750:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788612893.683767:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788612893.683774:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932396800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788612893.683788:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788612893.684421:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932397056 00000100:00100000:0.0:1788612893.684428:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932397056 00000100:00100000:0.0:1788612893.684468:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788612893.684498:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc73aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932397056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612893.685549:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932397440:0@lo:400:kworker.0 00000100:00100000:1.0:1788612893.685741:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612febbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932397056:0@lo:400:kworker.0 00000100:00100000:0.0:1788612893.688582:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc73aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932397056:12345-0@lo:400:kworker.0 Request processed in 4099us (5441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612893.688595:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788612893.688942:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932396800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5166us (8423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612893.688951:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788612893.689073:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fd9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932396800:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1788612894.001955:0:23512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788612894.063879:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612895.091549:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788612895.730453:0:23490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 85c43ba8-70ea-4b49-9ede-8fbb9c68d254 00000001:00100000:0.0:1788612895.730464:0:23490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of cca74f02-70d3-462b-9a97-5f7e9e5ea7bf 00000001:00100000:2.0:1788612895.731244:0:22736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 85c43ba8-70ea-4b49-9ede-8fbb9c68d254 00000001:00100000:2.0:1788612895.731252:0:22736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cca74f02-70d3-462b-9a97-5f7e9e5ea7bf 00010000:00010000:3.0:1788612896.122686:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612896.242644:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612896.242665:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932398208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788612896.242727:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612896.242771:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932398208 00000100:00100000:3.0:1788612896.242778:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932398208 00000100:00100000:3.0:1788612896.242823:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788612896.242847:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932398208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788612896.242874:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788612896.242912:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932398208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612896.242934:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788612896.242954:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612896.242984:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932398208:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1788612896.285462:0:25637:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1788612896.755283:0:25079:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 85c43ba8-70ea-4b49-9ede-8fbb9c68d254 00000001:00100000:1.0:1788612896.755297:0:25079:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cca74f02-70d3-462b-9a97-5f7e9e5ea7bf 00010000:00010000:1.0:1788612897.136825:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612897.266988:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788612897.267011:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932398336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612897.267080:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612897.269081:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932398336 00000100:00100000:0.0:1788612897.269097:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932398336 00000100:00100000:0.0:1788612897.269180:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788612897.269190:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932398336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788612897.269225:0:22762:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788612897.269301:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932398336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612897.269308:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788612897.269371:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932398336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788612897.274182:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961300f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932398464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788612897.274258:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612897.274416:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932398464 00000100:00100000:0.0:1788612897.274423:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932398464 00000100:00100000:0.0:1788612897.274505:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788612897.274515:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932398464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788612897.274567:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788612897.274616:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932398464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612897.274623:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788612897.274664:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961300f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932398464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788612897.883655:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612897.883695:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612897.883719:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612897.883735:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612897.883759:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612897.883778:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612897.883794:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612897.884687:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914462080 00000100:00100000:3.0:1788612897.884701:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914462080 00000100:00100000:3.0:1788612897.884775:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914462592 00000100:00100000:3.0:1788612897.884779:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914462592 00000100:00100000:3.0:1788612897.884798:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914462208 00000100:00100000:3.0:1788612897.884800:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914462208 00000100:00100000:3.0:1788612897.884818:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:3.0:1788612897.884827:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961300f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:2394:x1875495914462080:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612897.884904:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961300f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:2394:x1875495914462080:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 77us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612897.884911:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:3.0:1788612897.884929:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:3.0:1788612897.884936:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961300f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:2394:x1875495914462592:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612897.884960:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961300f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:2394:x1875495914462592:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612897.884967:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:3.0:1788612897.884979:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:3.0:1788612897.884985:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961300f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:2394:x1875495914462208:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612897.885010:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961300f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:2394:x1875495914462208:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612897.885016:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:0.0:1788612897.886898:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612897.886943:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612897.889070:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914461952 00000100:00100000:1.0:1788612897.889084:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914461952 00000100:00100000:1.0:1788612897.889168:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 144 00000100:00100000:1.0:1788612897.889179:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+13:2394:x1875495914461952:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612897.889245:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+13:2394:x1875495914461952:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 68us (5484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612897.889252:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 144 00000100:00100000:0.0:1788612897.892125:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914462720 00000100:00100000:0.0:1788612897.892144:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914462720 00000100:00100000:0.0:1788612897.892206:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:0.0:1788612897.892215:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961300f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+5:2394:x1875495914462720:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612897.892296:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961300f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+5:2394:x1875495914462720:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 82us (5406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612897.892304:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:3.0:1788612897.892768:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914462336 00000100:00100000:3.0:1788612897.892788:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914462336 00000100:00100000:3.0:1788612897.892826:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914462848 00000100:00100000:3.0:1788612897.892830:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914462848 00000100:00100000:3.0:1788612897.892845:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914462464 00000100:00100000:3.0:1788612897.892848:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914462464 00000100:00100000:3.0:1788612897.892859:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914462976 00000100:00100000:3.0:1788612897.892861:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914462976 00000100:00100000:3.0:1788612897.892877:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:3.0:1788612897.892885:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961300f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:2394:x1875495914462336:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612897.892919:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961300f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:2394:x1875495914462336:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (9223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612897.892926:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:3.0:1788612897.892940:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:3.0:1788612897.892946:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961300f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:2394:x1875495914462848:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612897.892969:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961300f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:2394:x1875495914462848:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (9232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612897.892976:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:3.0:1788612897.892988:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:3.0:1788612897.892994:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961300f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:2394:x1875495914462464:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612897.893016:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961300f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:2394:x1875495914462464:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (9222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612897.893039:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:3.0:1788612897.893051:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:3.0:1788612897.893057:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961300f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+5:2394:x1875495914462976:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612897.893081:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961300f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+5:2394:x1875495914462976:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (6138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612897.893094:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00080000:3.0:1788612897.893118:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788612897.893122:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788612897.893125:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788612897.893128:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788612898.160793:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612898.800073:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788612898.800096:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932398592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612898.800173:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612898.801175:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932398592 00000100:00100000:3.0:1788612898.801185:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932398592 00000100:00100000:3.0:1788612898.801246:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788612898.801256:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932398592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612898.801287:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788612898.801360:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932398592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612898.801367:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788612898.801387:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612898.801428:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932398592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612898.803218:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961300f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932398848:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.803280:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612898.803336:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961300f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932399360:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.803361:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612898.803394:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fd9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932399872:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.803420:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612898.803454:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788612898.803460:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961300f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932398976:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.803500:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612898.803517:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961300f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932399488:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.803537:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612898.803552:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fd9aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932400000:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.803572:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612898.803603:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932398848 00000100:00100000:0.0:1788612898.803610:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932398848 00000100:00100000:0.0:1788612898.803652:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788612898.803661:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fda18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932398848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.803711:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fda18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932398848:12345-0@lo:400:kworker.0 Request processed in 50us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612898.803717:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788612898.803739:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932399872 00000100:00100000:0.0:1788612898.803743:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932399872 00000100:00100000:0.0:1788612898.803773:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932400000 00000100:00100000:0.0:1788612898.803777:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932400000 00000100:00100000:0.0:1788612898.803794:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788612898.803800:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932399872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.803830:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875495932399872:12345-0@lo:400:kworker.0 Request processed in 30us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612898.805040:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788612898.805067:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788612898.805076:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932400000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.805134:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875495932400000:12345-0@lo:400:kworker.0 Request processed in 60us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612898.805141:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788612898.805164:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932399360 00000100:00100000:0.0:1788612898.805170:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932399360 00000100:00100000:0.0:1788612898.805213:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932398976 00000100:00100000:0.0:1788612898.805216:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932398976 00000100:00100000:0.0:1788612898.805236:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932399488 00000100:00100000:0.0:1788612898.805239:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932399488 00000100:00100000:0.0:1788612898.805253:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612898.805259:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fda1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932399360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.805290:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fda1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932399360:12345-0@lo:400:kworker.0 Request processed in 31us (1928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612898.805297:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788612898.805308:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788612898.805313:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932398976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.805350:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932398976:12345-0@lo:400:kworker.0 Request processed in 37us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612898.805355:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788612898.805366:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788612898.805372:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932399488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.805397:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932399488:12345-0@lo:400:kworker.0 Request processed in 27us (1859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612898.805402:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788612898.805432:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932400384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612898.805464:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612898.805533:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961300f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932398976:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.805544:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961300f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932399488:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.805553:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fd9aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875495932400000:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.805562:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961300f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932398848:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.805571:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961300f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932399360:0@lo:400:kworker.0 00010000:00080000:0.0:1788612898.805584:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fd9a9c00 x1875495932399872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612898.805595:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fd9a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875495932399872:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.805639:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961300f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932399104:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.805663:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612898.805679:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961300f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932399616:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.805698:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612898.805714:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fda19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932400128:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.805732:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612898.805748:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788612898.805754:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961300f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6b44f55-8b88-4406-a946-d178714afb91:3650:1875495932398720:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.805782:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612898.805807:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961300f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932399232:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.805828:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612898.807675:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932399104 00000100:00100000:3.0:1788612898.807688:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932399104 00000100:00100000:3.0:1788612898.807725:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932399616 00000100:00100000:3.0:1788612898.807729:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932399616 00000100:00100000:3.0:1788612898.807740:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932400128 00000100:00100000:3.0:1788612898.807743:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932400128 00000100:00100000:3.0:1788612898.807765:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788612898.807774:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932399104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612898.807859:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875495932399104:12345-0@lo:400:kworker.0 Request processed in 87us (2195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612898.807866:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788612898.807892:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788612898.807898:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932399616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612898.807928:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875495932399616:12345-0@lo:400:kworker.0 Request processed in 30us (2228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612898.807934:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788612898.807945:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788612898.807951:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932400128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612898.807977:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875495932400128:12345-0@lo:400:kworker.0 Request processed in 26us (2243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612898.807982:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788612898.809212:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961300f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932399744:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.809258:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612898.809285:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932400256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612898.809321:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612898.809370:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961300f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875495932399104:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.809382:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961300f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875495932399616:0@lo:400:kworker.0 00010000:00080000:0.0:1788612898.809394:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fda19f80 x1875495932400128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612898.809403:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fda19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875495932400128:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.809454:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932399744 00000100:00100000:0.0:1788612898.809459:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932399744 00000100:00100000:0.0:1788612898.809520:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788612898.809528:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961300f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932399744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.809582:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961300f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875495932399744:12345-0@lo:400:kworker.0 Request processed in 54us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612898.809589:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788612898.809615:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932398720 00000100:00100000:0.0:1788612898.809619:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932398720 00000100:00100000:0.0:1788612898.809644:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788612898.809650:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+24:3650:x1875495932398720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.809681:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+24:3650:x1875495932398720:12345-0@lo:400:kworker.0 Request processed in 31us (3898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612898.809687:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788612898.809712:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932399232 00000100:00100000:0.0:1788612898.809716:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932399232 00000100:00100000:0.0:1788612898.809738:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788612898.809745:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961300f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932399232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.809776:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961300f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932399232:12345-0@lo:400:kworker.0 Request processed in 32us (3947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612898.809788:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788612898.809814:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932400384 00000100:00100000:0.0:1788612898.809818:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932400384 00000100:00100000:0.0:1788612898.811499:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932400256 00000100:00100000:0.0:1788612898.811510:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932400256 00000100:00100000:0.0:1788612898.811550:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788612898.811559:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612febbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932400384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788612898.811588:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788612898.811665:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612febbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932400384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (6200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612898.811671:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788612898.811688:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788612898.811694:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961300f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932400256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788612898.811703:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788612898.811727:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961300f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932400256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (2405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612898.811733:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788612898.811778:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961300f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6b44f55-8b88-4406-a946-d178714afb91:3650:1875495932398720:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.811791:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961300f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932399232:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.811802:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961300f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875495932399744:0@lo:400:kworker.0 00000100:00100000:0.0:1788612898.811815:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932400256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612898.812766:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932400384:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788612898.813286:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788612898.813292:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788612898.813295:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788612898.813306:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:3.0:1788612898.813865:0:24260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 85c43ba8-70ea-4b49-9ede-8fbb9c68d254 00010000:00010000:1.0:1788612899.183704:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788612900.209878:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788612900.592228:0:22790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:1.0:1788612900.710849:0:25785:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7ada3cc0 20000000:00000080:1.0:1788612900.710867:0:25785:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9611c67dcc00 uarg=0000000000000000 20000000:01000000:1.0:1788612900.710911:0:25785:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788612900.710917:0:25785:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788612900.710922:0:25785:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788612900.714962:0:25786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788612900.722932:0:25785:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788612900.737631:0:25785:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788612900.738151:0:25785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc9f24 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612900.738172:0:25785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612e81dbc00/0x1f8616bf0bc9b81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b7a expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612900.738180:0:25785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc9b8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9b88 expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612900.738187:0:25785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc9bce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9bc7 expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612900.738193:0:25785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612e81da600/0x1f8616bf0bc9c68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9c61 expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612900.738203:0:25785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c0031800/0x1f8616bf0bc9eb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2270e expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612900.738210:0:25785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9612c0030000/0x1f8616bf0bc9ef3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2277e expref: 12 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612900.738217:0:25785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc9f24 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612900.738259:0:25785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c0030000/0x1f8616bf0bc9ef3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2277e expref: 12 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612900.738275:0:25785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612c0030000/0x1f8616bf0bc9ef3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2277e expref: 12 pid: 22748 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612900.738289:0:25785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961300f09880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875495932400512:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788612900.738412:0:25785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612c0031800/0x1f8616bf0bc9eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2270e expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612900.738422:0:25785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612c0031800/0x1f8616bf0bc9eb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2270e expref: 12 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612900.738431:0:25785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961300f08e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875495932400640:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788612900.738464:0:25785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612e81da600/0x1f8616bf0bc9c68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9c61 expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612900.738472:0:25785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612e81da600/0x1f8616bf0bc9c68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9c61 expref: 23 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612900.738505:0:25785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961300f09c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875495932400768:0@lo:104: 00000100:00100000:0.0:1788612900.738544:0:25785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612900.738577:0:25785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc9bce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9bc7 expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612900.738598:0:25785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc9bce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9bc7 expref: 23 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612900.738607:0:25785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961300f0b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875495932400896:0@lo:104: 00000100:00100000:0.0:1788612900.738629:0:25785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612900.738651:0:25785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc9b8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9b88 expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612900.738659:0:25785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc9b8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b88 expref: 23 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612900.738667:0:25785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fda19f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875495932401024:0@lo:104: 00000100:00100000:0.0:1788612900.738939:0:25785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788612900.738964:0:25785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9612e81dbc00/0x1f8616bf0bc9b81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1f8616bf0bc9b7a expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612900.738971:0:25785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9612e81dbc00/0x1f8616bf0bc9b81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b7a expref: 23 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612900.738980:0:25785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fcb45180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875495932401152:0@lo:104: 00000100:00100000:0.0:1788612900.739002:0:25785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612900.739013:0:25785:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea3b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788612900.742636:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612900.743187:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612900.743332:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932400768 00000100:00100000:2.0:1788612900.743341:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932400768 00000100:00100000:2.0:1788612900.743375:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932400896 00000100:00100000:2.0:1788612900.743379:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932400896 00000100:00100000:2.0:1788612900.743389:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932401024 00000100:00100000:2.0:1788612900.743391:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932401024 00000100:00100000:2.0:1788612900.743401:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932401152 00000100:00100000:2.0:1788612900.743404:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932401152 00000100:00100000:2.0:1788612900.743417:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788612900.743426:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961300f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6b44f55-8b88-4406-a946-d178714afb91+6:25785:x1875495932400768:12345-0@lo:104: 00010000:00010000:2.0:1788612900.743444:0:22740:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c13d0800/0x1f8616bf0bc9c61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9c68 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.743551:0:22740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788612900.743570:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961300f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6b44f55-8b88-4406-a946-d178714afb91+6:25785:x1875495932400768:12345-0@lo:104: Request processed in 146us (5026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612900.743578:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788612900.743605:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788612900.743611:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961300f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6b44f55-8b88-4406-a946-d178714afb91+5:25785:x1875495932400896:12345-0@lo:104: 00010000:00010000:2.0:1788612900.743620:0:22740:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c13d0e00/0x1f8616bf0bc9bc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9bce expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.743657:0:22740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788612900.743662:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961300f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6b44f55-8b88-4406-a946-d178714afb91+5:25785:x1875495932400896:12345-0@lo:104: Request processed in 52us (5033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612900.743669:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788612900.743680:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788612900.743686:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6b44f55-8b88-4406-a946-d178714afb91+4:25785:x1875495932401024:12345-0@lo:104: 00010000:00010000:2.0:1788612900.743693:0:22740:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9b88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9b8f expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.743877:0:22740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788612900.743883:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6b44f55-8b88-4406-a946-d178714afb91+4:25785:x1875495932401024:12345-0@lo:104: Request processed in 198us (4945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612900.743889:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788612900.743902:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788612900.743907:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6b44f55-8b88-4406-a946-d178714afb91+3:25785:x1875495932401152:12345-0@lo:104: 00010000:00010000:2.0:1788612900.743916:0:22740:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc9b7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9b81 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.743944:0:22740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788612900.743955:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6b44f55-8b88-4406-a946-d178714afb91+3:25785:x1875495932401152:12345-0@lo:104: Request processed in 48us (4952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612900.743961:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788612900.743987:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914463104 00000100:00100000:2.0:1788612900.743992:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914463104 00010000:00010000:2.0:1788612900.744010:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c0030000/0x1f8616bf0bc9ef3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2277e expref: 13 pid: 22748 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612900.744032:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914463232 00000100:00100000:2.0:1788612900.744035:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914463232 00010000:00010000:2.0:1788612900.744047:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612c0031800/0x1f8616bf0bc9eb4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2270e expref: 14 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612900.744059:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:2.0:1788612900.744064:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+14:2394:x1875495914463104:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612900.744074:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612900.744078:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c0030000/0x1f8616bf0bc9ef3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2277e expref: 14 pid: 22748 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.744088:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c0030000/0x1f8616bf0bc9ef3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2277e expref: 14 pid: 22748 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.744105:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612900.744255:0:25785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c0030000/0x1f8616bf0bc9ef3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2277e expref: 14 pid: 22748 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612900.744270:0:25785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961300f09880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875495932400512:192.168.203.30@tcp:104: 00000100:00100000:0.0:1788612900.744281:0:25785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961300f08e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875495932400640:192.168.203.30@tcp:104: 00000100:00100000:0.0:1788612900.744289:0:25785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961300f09c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875495932400768:0@lo:104: 00000100:00100000:0.0:1788612900.744297:0:25785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961300f0b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875495932400896:0@lo:104: 00000100:00100000:0.0:1788612900.744304:0:25785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fda19f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875495932401024:0@lo:104: 00000100:00100000:0.0:1788612900.744322:0:25785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fcb45180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875495932401152:0@lo:104: 00010000:00010000:0.0:1788612900.744355:0:25785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc9f24 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744489:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788612900.744497:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c13d0800/0x1f8616bf0bc9c61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9c68 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744503:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d0800 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612900.744507:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d0800/0x1f8616bf0bc9c61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc9c68 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744515:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c13d0800/0x1f8616bf0bc9c61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc9c68 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612900.744522:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d0800/0x1f8616bf0bc9c61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc9c68 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612900.744535:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788612900.744568:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c13d0800/0x1f8616bf0bc9c61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9c68 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744574:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612900.744607:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c13d0800/0x1f8616bf0bc9c61 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9c68 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744615:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c13d0800/0x1f8616bf0bc9c61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9c68 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744626:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788612900.744629:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c13d0e00/0x1f8616bf0bc9bc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9bce expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744634:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d0e00 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612900.744637:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d0e00/0x1f8616bf0bc9bc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc9bce expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744644:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c13d0e00/0x1f8616bf0bc9bc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc9bce expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612900.744650:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d0e00/0x1f8616bf0bc9bc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc9bce expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612900.744655:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788612900.744669:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c13d0e00/0x1f8616bf0bc9bc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9bce expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744674:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612900.744699:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c13d0e00/0x1f8616bf0bc9bc7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9bce expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744718:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c13d0e00/0x1f8616bf0bc9bc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9bce expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744727:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788612900.744730:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9b88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9b8f expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744743:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37000 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612900.744746:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9b88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc9b8f expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744752:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9b88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc9b8f expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612900.744758:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9b88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc9b8f expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612900.744762:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788612900.744776:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9b88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9b8f expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744781:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612900.744787:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9b88 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9b8f expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744792:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9b88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9b8f expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744801:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612900.744810:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc9b7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1f8616bf0bc9b81 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744815:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c13d0600 already unused, calling callback (ffffffffc123cc20) 10000000:00010000:3.0:1788612900.744818:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc9b7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1f8616bf0bc9b81 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744824:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc9b7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1f8616bf0bc9b81 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788612900.744829:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc9b7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1f8616bf0bc9b81 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612900.744834:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788612900.744848:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc9b7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9b81 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744852:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788612900.744858:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc9b7a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9b81 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744863:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9612c13d0600/0x1f8616bf0bc9b7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1f8616bf0bc9b81 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.744874:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612900.744876:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612900.744878:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612900.744891:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6b44f55-8b88-4406-a946-d178714afb91:3649:1875495932401280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612900.744931:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612900.744962:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612900.744968:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6b44f55-8b88-4406-a946-d178714afb91:3649:1875495932401664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612900.744997:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612900.745020:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6b44f55-8b88-4406-a946-d178714afb91:3650:1875495932401408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612900.745044:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612900.745056:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788612900.745061:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6b44f55-8b88-4406-a946-d178714afb91:3650:1875495932401536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612900.745081:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788612900.745132:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612900.745144:0:22741:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788612900.745153:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788612900.745245:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932401280 00000100:00100000:3.0:1788612900.745250:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932401280 00010000:00010000:3.0:1788612900.745269:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612e81da600/0x1f8616bf0bc9c68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9c61 expref: 24 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612900.745286:0:22741:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788612900.745292:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932401664 00000100:00100000:3.0:1788612900.745295:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932401664 00010000:00010000:3.0:1788612900.745304:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9612e81dbc00/0x1f8616bf0bc9b81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b7a expref: 25 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612900.745325:0:22741:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788612900.745330:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932401408 00000100:00100000:3.0:1788612900.745333:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932401408 00010000:00010000:3.0:1788612900.745342:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc9bce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9bc7 expref: 26 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612900.745351:0:22741:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788612900.745355:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932401536 00000100:00100000:3.0:1788612900.745357:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932401536 00010000:00010000:3.0:1788612900.745366:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc9b8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b88 expref: 27 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612900.745388:0:22741:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788612900.745398:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:3.0:1788612900.745418:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+13:2394:x1875495914463232:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612900.745430:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612900.745436:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612c0031800/0x1f8616bf0bc9eb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2270e expref: 13 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.745446:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612c0031800/0x1f8616bf0bc9eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2270e expref: 13 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.745459:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c0031800/0x1f8616bf0bc9eb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2270e expref: 13 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.745469:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612900.745830:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+12:2394:x1875495914463104:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 1763us (3201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612900.745840:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:2.0:1788612900.745856:0:22743:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788612900.745863:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788612900.745869:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b44f55-8b88-4406-a946-d178714afb91+27:3649:x1875495932401280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612900.745884:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612900.745890:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612e81da600/0x1f8616bf0bc9c68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9c61 expref: 27 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.745899:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612e81da600/0x1f8616bf0bc9c68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9c61 expref: 27 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.745910:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612e81da600/0x1f8616bf0bc9c68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9c61 expref: 27 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.745918:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612900.745955:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b44f55-8b88-4406-a946-d178714afb91+26:3649:x1875495932401280:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612900.745961:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788612900.745974:0:22743:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788612900.745981:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788612900.745986:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b44f55-8b88-4406-a946-d178714afb91+25:3649:x1875495932401664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612900.745993:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612900.745997:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9612e81dbc00/0x1f8616bf0bc9b81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b7a expref: 25 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.746005:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9612e81dbc00/0x1f8616bf0bc9b81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b7a expref: 25 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.746014:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612e81dbc00/0x1f8616bf0bc9b81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9b7a expref: 25 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.746022:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612900.746045:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b44f55-8b88-4406-a946-d178714afb91+24:3649:x1875495932401664:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612900.746058:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788612900.746070:0:22743:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788612900.746077:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788612900.746082:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e97edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b44f55-8b88-4406-a946-d178714afb91+23:3650:x1875495932401408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612900.746090:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612900.746094:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc9bce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9bc7 expref: 23 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.746103:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc9bce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9bc7 expref: 23 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.746113:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a2c00/0x1f8616bf0bc9bce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9bc7 expref: 23 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.746123:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612900.746152:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e97edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b44f55-8b88-4406-a946-d178714afb91+22:3650:x1875495932401408:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612900.746158:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788612900.746169:0:22743:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788612900.746175:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788612900.746180:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b44f55-8b88-4406-a946-d178714afb91+21:3650:x1875495932401536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788612900.746200:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612900.746206:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc9b8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b88 expref: 21 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.746214:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc9b8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1f8616bf0bc9b88 expref: 21 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.746231:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9611c67a3a00/0x1f8616bf0bc9b8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1f8616bf0bc9b88 expref: 21 pid: 22751 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.746242:0:22743:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc9f24 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.746250:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc9f24 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.746262:0:22743:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc9f24 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.746269:0:22743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc9f24 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.746275:0:22743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc9f24 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.746281:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc9f24 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.746287:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897000 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612900.746290:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc9f24 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.746299:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc9f24 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.746327:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc9f24 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612900.746347:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612900.746371:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b44f55-8b88-4406-a946-d178714afb91+20:3650:x1875495932401536:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612900.746377:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788612900.746426:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb853480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6b44f55-8b88-4406-a946-d178714afb91:3649:1875495932401664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612900.746436:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6b44f55-8b88-4406-a946-d178714afb91:3649:1875495932401280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612900.746465:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6b44f55-8b88-4406-a946-d178714afb91:3650:1875495932401536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788612900.746473:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6b44f55-8b88-4406-a946-d178714afb91:3650:1875495932401408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788612900.747381:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+11:2394:x1875495914463232:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 1970us (4189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612900.747391:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00010000:00010000:3.0:1788612900.747601:0:25785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc9f24 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.747613:0:25785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc9f24 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612900.747619:0:25785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9612c2897000/0x1f8616bf0bc9f24 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612901.236378:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612901.359886:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932401792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788612901.359955:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612901.360582:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932401792 00000100:00100000:3.0:1788612901.360602:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932401792 00000100:00100000:3.0:1788612901.360663:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788612901.360672:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932401792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788612901.360708:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788612901.360767:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932401792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612901.360774:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788612901.360914:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932401792:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788612901.360974:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1788612901.872071:0:22753:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788612901.872079:0:22753:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612e0944800 from 13 10000000:01000000:0.0:1788612901.872085:0:22753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788612901.872143:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896200/0x1f8616bf0bc9f2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612901.872174:0:22753:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c2896200/0x1f8616bf0bc9f2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612901.872186:0:22753:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c2896200/0x1f8616bf0bc9f2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612901.872213:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fcb45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932401920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788612901.872292:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612901.872344:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea3b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788612901.872521:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932401920 00000100:00100000:1.0:1788612901.872529:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932401920 00000100:00100000:1.0:1788612901.872580:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788612901.872589:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+20:22753:x1875495932401920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612901.872602:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612901.872615:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c7240c00/0x1f8616bf0bc9f32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9f2b expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612901.872638:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c7240c00/0x1f8616bf0bc9f32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9f2b expref: 21 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612901.872649:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c7240c00/0x1f8616bf0bc9f32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9f2b expref: 21 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612901.872657:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240c00, rc 0) 00000100:00100000:1.0:1788612901.872716:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+21:22753:x1875495932401920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612901.872723:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788612901.873078:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fcb45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932401920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612901.873095:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c2896200/0x1f8616bf0bc9f2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9f32 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612901.873104:0:22753:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c2896200/0x1f8616bf0bc9f2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9f32 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612901.873172:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932402048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612901.873199:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612901.873227:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e216f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612901.873398:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932402048 00000100:00100000:1.0:1788612901.873402:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932402048 00000100:00100000:1.0:1788612901.873435:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788612901.873442:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+21:22753:x1875495932402048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612901.874254:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+21:22753:x1875495932402048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 809us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612901.874278:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788612901.875870:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932402048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612901.875934:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932402176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612901.876008:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612901.876055:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c92f9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788612901.877257:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932402176 00000100:00100000:0.0:1788612901.877269:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932402176 00000100:00100000:0.0:1788612901.877345:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788612901.877355:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+21:22753:x1875495932402176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612901.879373:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+21:22753:x1875495932402176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2012us (3358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612901.879387:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788612901.879901:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932402176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788612901.881338:0:25799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788612901.881770:0:22753:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788612901.881794:0:22753:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788612901.881819:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c2896200/0x1f8616bf0bc9f2b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9f32 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612901.881831:0:22753:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c2896200/0x1f8616bf0bc9f2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9f32 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612901.881842:0:22753:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788612901.881845:0:22753:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9611c68fd800 from 13 10000000:01000000:2.0:1788612901.881848:0:22753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788612901.881883:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c0031800/0x1f8616bf0bc9f39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612901.881892:0:22753:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c0031800/0x1f8616bf0bc9f39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612901.881904:0:22753:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c0031800/0x1f8616bf0bc9f39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612901.881928:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932402304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612901.881991:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612901.882038:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e216f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788612901.882450:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932402304 00000100:00100000:1.0:1788612901.882459:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932402304 00000100:00100000:1.0:1788612901.882551:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788612901.882562:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+21:22753:x1875495932402304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612901.882575:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612901.882589:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c7240600/0x1f8616bf0bc9f40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9f39 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612901.882612:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c7240600/0x1f8616bf0bc9f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9f39 expref: 22 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612901.882622:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c7240600/0x1f8616bf0bc9f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9f39 expref: 22 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612901.882630:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240600, rc 0) 00000100:00100000:1.0:1788612901.882682:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+22:22753:x1875495932402304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612901.882689:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788612901.884054:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932402304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612901.884077:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c0031800/0x1f8616bf0bc9f39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9f40 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612901.884088:0:22753:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c0031800/0x1f8616bf0bc9f39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9f40 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612901.884178:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932402432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612901.884370:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612901.884415:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e216f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788612901.887070:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932402432 00000100:00100000:1.0:1788612901.887083:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932402432 00000100:00100000:1.0:1788612901.887150:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788612901.887159:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+22:22753:x1875495932402432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612901.887325:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+22:22753:x1875495932402432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (2954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612901.887333:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788612901.887643:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932402432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612901.887689:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932402560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788612901.887752:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612901.887780:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c92f9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612901.888441:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932402560 00000100:00100000:2.0:1788612901.888447:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932402560 00000100:00100000:2.0:1788612901.888515:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788612901.888523:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612dfcd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+22:22753:x1875495932402560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612901.888617:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612dfcd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+22:22753:x1875495932402560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612901.888624:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788612901.888885:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932402560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788612901.890063:0:25800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788612901.890985:0:22753:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788612901.891010:0:22753:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788612901.891022:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c0031800/0x1f8616bf0bc9f39 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9f40 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612901.891033:0:22753:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c0031800/0x1f8616bf0bc9f39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9f40 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788612901.891060:0:22753:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788612901.891062:0:22753:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9611c6492800 from 13 10000000:01000000:3.0:1788612901.891065:0:22753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788612901.891100:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9f47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612901.891108:0:22753:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9f47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612901.891188:0:22753:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9f47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612901.891212:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932402688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788612901.891343:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612901.891448:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c92f9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788612901.891816:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932402688 00000100:00100000:2.0:1788612901.891823:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932402688 00000100:00100000:2.0:1788612901.891917:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788612901.891927:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+22:22753:x1875495932402688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612901.891939:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612901.891955:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c0030000/0x1f8616bf0bc9f4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9f47 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612901.891981:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c0030000/0x1f8616bf0bc9f4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9f47 expref: 23 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612901.891990:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c0030000/0x1f8616bf0bc9f4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9f47 expref: 23 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612901.891998:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0030000, rc 0) 00000100:00100000:2.0:1788612901.892044:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b44f55-8b88-4406-a946-d178714afb91+23:22753:x1875495932402688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612901.892051:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788612901.892154:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932402688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788612901.892168:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9f47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9f4e expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612901.892177:0:22753:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9f47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9f4e expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612901.892241:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932402816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788612901.892273:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612901.892562:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c92f9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788612901.892888:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932402816 00000100:00100000:1.0:1788612901.892894:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932402816 00000100:00100000:1.0:1788612901.892934:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788612901.892943:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+23:22753:x1875495932402816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612901.893060:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+23:22753:x1875495932402816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612901.893067:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788612901.893381:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932402816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612901.893429:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932402944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612901.893470:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612901.893711:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e216f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788612901.893830:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932402944 00000100:00100000:0.0:1788612901.893835:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932402944 00000100:00100000:1.0:1788612901.894217:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788612901.894226:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+23:22753:x1875495932402944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612901.894445:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+23:22753:x1875495932402944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612901.894452:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788612901.895085:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932402944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788612901.896418:0:25801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788612901.902870:0:22753:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788612901.902905:0:22753:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788612901.902971:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9f47 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9f4e expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612901.902983:0:22753:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612f7b37000/0x1f8616bf0bc9f47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9f4e expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788612901.902994:0:22753:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788612901.902997:0:22753:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9612e9172000 from 13 10000000:01000000:2.0:1788612901.903000:0:22753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788612901.903040:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c0031200/0x1f8616bf0bc9f55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612901.903047:0:22753:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9612c0031200/0x1f8616bf0bc9f55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612901.903057:0:22753:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9612c0031200/0x1f8616bf0bc9f55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612901.903079:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932403072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788612901.903343:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612901.903429:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e216f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788612901.903651:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932403072 00000100:00100000:1.0:1788612901.903659:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932403072 00000100:00100000:1.0:1788612901.903935:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788612901.903945:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+23:22753:x1875495932403072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612901.903958:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612901.903972:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c7240200/0x1f8616bf0bc9f5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f8616bf0bc9f55 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612901.903993:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c7240200/0x1f8616bf0bc9f5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1f8616bf0bc9f55 expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612901.904003:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c7240200/0x1f8616bf0bc9f5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1f8616bf0bc9f55 expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612901.904012:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240200, rc 0) 00000100:00100000:1.0:1788612901.904076:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:22753:x1875495932403072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612901.904083:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788612901.904169:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932403072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788612901.904191:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9612c0031200/0x1f8616bf0bc9f55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9f5c expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612901.904211:0:22753:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9612c0031200/0x1f8616bf0bc9f55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1f8616bf0bc9f5c expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612901.904462:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932403200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612901.904527:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612901.929945:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e216f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788612901.934632:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932403200 00000100:00100000:1.0:1788612901.934646:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932403200 00000100:00100000:1.0:1788612901.937647:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788612901.937669:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:22753:x1875495932403200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788612901.937843:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:22753:x1875495932403200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (33314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612901.937851:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788612901.938051:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932403200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612901.938099:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932403328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788612901.938162:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612901.938197:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e216f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788612901.938568:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932403328 00000100:00100000:1.0:1788612901.938574:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932403328 00000100:00100000:1.0:1788612901.938604:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788612901.938610:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:22753:x1875495932403328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788612901.938690:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:22753:x1875495932403328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612901.938708:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788612901.939368:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6b44f55-8b88-4406-a946-d178714afb91:22753:1875495932403328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788612901.941621:0:25802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788612901.942030:0:22753:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788612901.942052:0:22753:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788612901.942064:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9612c0031200/0x1f8616bf0bc9f55 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9f5c expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612901.942076:0:22753:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9612c0031200/0x1f8616bf0bc9f55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1f8616bf0bc9f5c expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612902.255825:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612902.384414:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932403584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788612902.384539:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612902.384578:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612902.384584:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fcb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932403456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788612902.384606:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612902.384754:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932403584 00000100:00100000:1.0:1788612902.384762:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932403584 00000100:00100000:1.0:1788612902.384813:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932403456 00000100:00100000:1.0:1788612902.384822:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932403456 00000100:00100000:1.0:1788612902.384842:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788612902.384851:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932403584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788612902.384885:0:22762:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788612902.384936:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932403584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612902.384943:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788612902.384961:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788612902.384968:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932403456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788612902.384984:0:22762:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788612902.385012:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932403456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612902.385017:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788612902.385471:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fcb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932403456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788612902.385575:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932403584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788612902.552987:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612902.554931:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914463360 00000100:00100000:1.0:1788612902.554945:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914463360 00000100:00100000:1.0:1788612902.555016:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 158 00000100:00100000:1.0:1788612902.555027:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+11:18073:x1875495914463360:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612902.555044:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612902.555062:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c7241400/0x1f8616bf0bc9f63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d227b6 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612902.555121:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c7241400/0x1f8616bf0bc9f63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227b6 expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612902.555134:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c7241400/0x1f8616bf0bc9f63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227b6 expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612902.555152:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241400, rc 0) 00000100:00100000:1.0:1788612902.555227:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+12:18073:x1875495914463360:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 200us (2248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612902.555234:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 158 00000100:00100000:0.0:1788612902.560514:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612902.562922:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914463488 00000100:00100000:2.0:1788612902.562938:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914463488 00000100:00100000:2.0:1788612902.563023:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:2.0:1788612902.563034:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+12:18073:x1875495914463488:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612902.563196:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+12:18073:x1875495914463488:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 164us (2722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612902.563205:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:3.0:1788612902.569904:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612902.572051:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914463616 00000100:00100000:0.0:1788612902.572066:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914463616 00000100:00100000:0.0:1788612902.572150:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 160 00000100:00100000:0.0:1788612902.572162:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+12:18073:x1875495914463616:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612902.572540:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+12:18073:x1875495914463616:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 378us (2645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612902.572548:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 160 00000100:00100000:3.0:1788612902.603096:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612902.604784:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914463744 00000100:00100000:1.0:1788612902.604798:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914463744 00000100:00100000:1.0:1788612902.604868:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 161 00000100:00100000:1.0:1788612902.604879:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+12:18073:x1875495914463744:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788612902.604896:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612902.604917:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9612c7240a00/0x1f8616bf0bc9f6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d227bd expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612902.604944:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9612c7240a00/0x1f8616bf0bc9f6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227bd expref: 13 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612902.604954:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9612c7240a00/0x1f8616bf0bc9f6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227bd expref: 13 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612902.604964:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240a00, rc 0) 00000100:00100000:1.0:1788612902.605034:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a495520c-d9bc-4ce5-bb68-b6caa50213a1+13:18073:x1875495914463744:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 157us (1947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612902.605041:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 161 00000100:00100000:1.0:1788612902.624801:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612902.624953:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914463872 00000100:00100000:2.0:1788612902.624964:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914463872 00000100:00100000:2.0:1788612902.625026:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 162 00000100:00100000:2.0:1788612902.625052:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+13:18073:x1875495914463872:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788612902.625225:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+13:18073:x1875495914463872:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 175us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612902.625234:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 162 00000100:00100000:3.0:1788612902.628639:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612902.628755:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914464000 00000100:00100000:0.0:1788612902.628764:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914464000 00000100:00100000:0.0:1788612902.628823:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 163 00000100:00100000:0.0:1788612902.628834:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+13:18073:x1875495914464000:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788612902.628979:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a495520c-d9bc-4ce5-bb68-b6caa50213a1+13:18073:x1875495914464000:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 146us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612902.628988:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 163 00000100:00100000:3.0:1788612902.782674:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612902.782847:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914464128 00000100:00100000:0.0:1788612902.782857:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914464128 00000100:00100000:0.0:1788612902.782942:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:0.0:1788612902.782955:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:18695:x1875495914464128:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612902.782975:0:25550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612902.782996:0:25550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896800/0x1f8616bf0bc9f71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d227c4 expref: -99 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783062:0:25550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783077:0:25550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783091:0:25550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783110:0:25550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783118:0:25550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783146:0:25550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783230:0:25550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc9f86 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783239:0:25550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc9f86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783246:0:25550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc9f86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612902.783273:0:25550:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788612902.783277:0:25550:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612902.783324:0:25550:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc9f86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783335:0:25550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783342:0:25550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f78 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783348:0:25550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783353:0:25550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612902.783357:0:25550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783364:0:25550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783382:0:25550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7800) 00010000:00010000:0.0:1788612902.783384:0:25550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612902.783389:0:25550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783395:0:25550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783408:0:25550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783414:0:25550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783419:0:25550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783423:0:25550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612902.783426:0:25550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783431:0:25550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783437:0:25550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9611c66e5c00) 00010000:00010000:0.0:1788612902.783440:0:25550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612902.783442:0:25550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f7f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783447:0:25550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783554:0:25550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896800/0x1f8616bf0bc9f71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227c4 expref: 8 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783568:0:25550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897200/0x1f8616bf0bc9f86 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227c4 expref: 7 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.783575:0:25550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9611c66e5000) 00010000:00010000:0.0:1788612902.783577:0:25550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788612902.783579:0:25550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897200, rc 0) 00000100:00100000:0.0:1788612902.783635:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+7:18695:x1875495914464128:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 683us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612902.783642:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00080000:3.0:1788612902.784675:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612902.817029:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612902.822606:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914464256 00000100:00100000:3.0:1788612902.822623:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914464256 00000100:00100000:3.0:1788612902.822695:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:3.0:1788612902.822706:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+7:18695:x1875495914464256:12345-192.168.203.30@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788612902.822863:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+7:18695:x1875495914464256:12345-192.168.203.30@tcp:900:lhsmtool_posix.0 Request processed in 157us (5843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612902.822871:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:3.0:1788612902.841645:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612902.847419:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914464512 00000100:00100000:0.0:1788612902.847445:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914464512 00000100:00100000:0.0:1788612902.847720:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:0.0:1788612902.847733:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+7:18695:x1875495914464512:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612902.847753:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612902.847777:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896800/0x1f8616bf0bc9f8d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d227cb expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.847855:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f94 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.847869:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f94 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.847882:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f94 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.847955:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f9b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.847964:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.847971:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.848075:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc9fa2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.848083:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc9fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.848090:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc9fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612902.848100:0:22756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788612902.848305:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f94 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.848314:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f94 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.848320:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f94 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.848325:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612902.848330:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f94 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.848347:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f94 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.848358:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9611c66e5000) 00010000:00010000:0.0:1788612902.848361:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612902.848366:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f94 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.848372:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bc9f94 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.848385:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.848392:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f9b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.848397:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f9b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.848402:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612902.848404:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f9b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.848409:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f9b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.848416:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9611c66e5c00) 00010000:00010000:0.0:1788612902.848418:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612902.848421:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f9b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612902.848447:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897600/0x1f8616bf0bc9f9b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.859795:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896800/0x1f8616bf0bc9f8d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227cb expref: 10 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.859824:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897a00/0x1f8616bf0bc9fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227cb expref: 9 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.859834:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9611c66e5200) 00010000:00010000:2.0:1788612902.859838:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612902.859841:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897a00, rc 0) 00000100:00100000:2.0:1788612902.859977:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+9:18695:x1875495914464512:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 12246us (18340us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788612902.859986:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:1.0:1788612902.885248:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612902.890739:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612902.902380:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914464640 00000100:00100000:2.0:1788612902.902396:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914464640 00000100:00100000:2.0:1788612902.902504:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914464768 00000100:00100000:2.0:1788612902.902509:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914464768 00000100:00100000:2.0:1788612902.902534:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:2.0:1788612902.902545:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+10:18701:x1875495914464640:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788612902.902566:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612902.902587:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc9fb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d227d2 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902655:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9fb7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902684:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9fb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902696:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9fb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902755:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fbe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902763:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902769:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902812:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9fb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902819:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9fb7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902825:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9fb7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902830:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612902.902834:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9fb7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902841:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9fb7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902852:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7800) 00010000:00010000:2.0:1788612902.902860:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612902.902866:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9fb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902871:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9fb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902886:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902891:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fbe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902896:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902901:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0031a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612902.902903:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902908:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fbe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902915:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9612c93f7c00) 00010000:00010000:2.0:1788612902.902917:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612902.902920:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fbe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902925:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fbe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902956:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc9fb0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227d2 expref: 11 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902977:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7800) 00010000:00010000:2.0:1788612902.902980:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612902.902984:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bc9fb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227d2 expref: 11 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.902993:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0030e00, rc 0) 00000100:00100000:2.0:1788612902.903052:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+10:18701:x1875495914464640:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 508us (17838us total) trans 0 rc 301/301 00000100:00100000:2.0:1788612902.903059:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:2.0:1788612902.903077:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:2.0:1788612902.903085:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+9:18695:x1875495914464768:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788612902.903146:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+9:18695:x1875495914464768:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 62us (12418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612902.903153:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:1.0:1788612902.908918:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612902.909001:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914464896 00000100:00100000:2.0:1788612902.909011:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914464896 00000100:00100000:2.0:1788612902.909091:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:2.0:1788612902.909102:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:18695:x1875495914464896:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1788612902.912867:0:22756:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3704us 00000100:00080000:3.0:1788612902.913260:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788612902.913410:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612902.915575:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914465024 00000100:00100000:3.0:1788612902.915589:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914465024 00000100:00100000:3.0:1788612902.915644:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:3.0:1788612902.915655:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+9:18701:x1875495914465024:12345-192.168.203.30@tcp:700:lfs.0 00000100:00100000:3.0:1788612902.915764:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+9:18701:x1875495914465024:12345-192.168.203.30@tcp:700:lfs.0 Request processed in 111us (2356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612902.915772:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:1.0:1788612902.921855:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612902.923377:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914465280 00000100:00100000:3.0:1788612902.923391:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914465280 00000100:00100000:3.0:1788612902.923471:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:3.0:1788612902.923835:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+9:18701:x1875495914465280:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:3.0:1788612902.923888:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612902.923914:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bc9ede lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2273f expref: 9 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612902.923934:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7800) 00010000:00010000:3.0:1788612902.923940:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612902.924002:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc9fc5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612902.924015:0:22758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc9f1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227af expref: 5 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612902.924023:0:22758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc9fc5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612902.924057:0:22758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc9f1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227af expref: 5 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612902.924084:0:22758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc9f1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227af expref: 5 pid: 22757 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612902.924133:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb851880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22758:1875495932403712:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612902.924242:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c92f9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788612902.930951:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612902.933515:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914465408 00000100:00100000:2.0:1788612902.933529:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914465408 00010000:00010000:2.0:1788612902.933590:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc9f1d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227af expref: 6 pid: 22757 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612902.933625:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:2.0:1788612902.933636:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:2395:x1875495914465408:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612902.933660:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612902.933667:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc9f1d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227af expref: 6 pid: 22757 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.933682:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc9f1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227af expref: 6 pid: 22757 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.933705:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7800) 00010000:00010000:2.0:1788612902.933710:0:22743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc9fc5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.933719:0:22743:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc9fc5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.933725:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc9fc5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.933744:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612902.933801:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:2395:x1875495914465408:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 167us (2860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612902.933809:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00010000:00010000:2.0:1788612902.933876:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc9f1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227af expref: 5 pid: 22757 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612902.933889:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb851880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22758:1875495932403712:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612902.933909:0:22758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc9fc5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.933917:0:22758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc9fc5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.933930:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc9fc5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.933950:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fcc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.933958:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fcc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612902.933967:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fcc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612902.942870:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc9fd3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612902.942891:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc9fd3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612902.942903:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc9fd3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788612902.942918:0:22758:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf4b7b2b reply state 00000000a87d729e transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc9fd3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612902.942928:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc9fd3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612902.942935:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9611c76e7b00) 00010000:00010000:3.0:1788612902.942937:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788612902.942942:0:22758:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788612902.942947:0:22758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788612902.942954:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc9fc5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612902.942960:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc9fc5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612902.942966:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc9fc5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612902.942982:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612902.942987:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc9fc5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612902.942993:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc9fc5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612902.943004:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612c93f7800) 00010000:00010000:3.0:1788612902.943006:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612902.943010:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc9fc5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612902.943015:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc9fc5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788612902.943034:0:22758:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf4b7b2b reply state 00000000a87d729e transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fcc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612902.943041:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fcc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612902.943046:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9612c93f7c00) 00010000:00010000:3.0:1788612902.943048:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788612902.943050:0:22758:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788612902.943181:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:18695:x1875495914464896:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 34076us (34268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612902.943191:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00080000:0.0:1788612902.943665:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612902.946958:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+10:18701:x1875495914465280:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 23116us (25100us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788612902.946970:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:3.0:1788612903.005195:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612903.005248:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612903.005286:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612903.005344:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612903.005387:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612903.005733:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914465536 00000100:00100000:2.0:1788612903.005744:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914465536 00000100:00100000:2.0:1788612903.005816:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914466048 00000100:00100000:2.0:1788612903.005830:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914466048 00000100:00100000:2.0:1788612903.005846:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914465664 00000100:00100000:2.0:1788612903.005849:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914465664 00000100:00100000:2.0:1788612903.005862:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914465920 00000100:00100000:2.0:1788612903.005864:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914465920 00000100:00100000:2.0:1788612903.005881:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:2.0:1788612903.005890:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:2396:x1875495914465536:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612903.005958:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:2396:x1875495914465536:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 68us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612903.005966:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:2.0:1788612903.005983:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:2.0:1788612903.005990:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+5:2396:x1875495914466048:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612903.006014:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+5:2396:x1875495914466048:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612903.006029:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:2.0:1788612903.006042:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:2.0:1788612903.006048:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:2396:x1875495914465664:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612903.006071:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:2396:x1875495914465664:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612903.006076:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:2.0:1788612903.006086:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:2.0:1788612903.006092:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+5:2396:x1875495914465920:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788612903.006124:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+5:2396:x1875495914465920:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 32us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612903.006131:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:1.0:1788612903.006652:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914465792 00000100:00100000:1.0:1788612903.006658:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914465792 00000100:00100000:1.0:1788612903.006710:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:1.0:1788612903.006719:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+5:2396:x1875495914465792:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612903.006757:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+5:2396:x1875495914465792:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 40us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612903.006763:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00080000:3.0:1788612903.008693:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788612903.008704:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788612903.008706:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788612903.098754:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612903.098843:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914466176 00000100:00100000:1.0:1788612903.098852:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914466176 00000100:00100000:1.0:1788612903.098911:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:1.0:1788612903.098919:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+10:18709:x1875495914466176:12345-192.168.203.30@tcp:101:lctl.0 00010000:00010000:1.0:1788612903.098942:0:24230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612903.098965:0:24230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc9fda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d227d9 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.099021:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc9fe1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.099034:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc9fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.099046:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc9fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612903.099086:0:24230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788612903.099101:0:24230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788612903.099135:0:24230:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc9fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.099157:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bc9fda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227d9 expref: 12 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.099176:0:24230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241e00/0x1f8616bf0bc9fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227d9 expref: 11 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.099185:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612fb832000) 00010000:00010000:1.0:1788612903.099188:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788612903.099191:0:24230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241e00, rc 0) 00000100:00100000:1.0:1788612903.099255:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+11:18709:x1875495914466176:12345-192.168.203.30@tcp:101:lctl.0 Request processed in 335us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612903.099262:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:2.0:1788612903.151055:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612903.151146:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914466304 00000100:00100000:3.0:1788612903.151156:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914466304 00000100:00100000:3.0:1788612903.151217:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:3.0:1788612903.151227:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+5:18710:x1875495914466304:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788612903.151253:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612903.151275:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc9fe8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d227e0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612903.151358:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc9fef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612903.151372:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc9fef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612903.151385:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc9fef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612903.151428:0:22758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788612903.151432:0:22758:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788612903.151449:0:22758:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc9fef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612903.151473:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bc9fe8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227e0 expref: 7 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612903.151861:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36e00/0x1f8616bf0bc9fef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227e0 expref: 6 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612903.151870:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612fb832000) 00010000:00010000:3.0:1788612903.151873:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788612903.151876:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36e00, rc 0) 00000100:00100000:3.0:1788612903.151942:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:18710:x1875495914466304:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 716us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612903.151949:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:3.0:1788612903.158120:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612903.158364:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914466432 00000100:00100000:2.0:1788612903.158374:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914466432 00000100:00100000:2.0:1788612903.158441:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:2.0:1788612903.158452:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:18710:x1875495914466432:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788612903.158472:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612903.158533:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031000/0x1f8616bf0bc9ff6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d227e7 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158596:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9ffd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158610:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9ffd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158638:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9ffd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158652:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca004 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158660:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158667:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158753:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca00b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158761:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca00b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158768:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca00b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612903.158805:0:22757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788612903.158809:0:22757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788612903.158831:0:22757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca00b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158843:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9ffd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158850:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9ffd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158866:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9ffd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158872:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612903.158876:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9ffd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158883:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9ffd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158895:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612fb832000) 00010000:00010000:2.0:1788612903.158898:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612903.158902:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9ffd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158909:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bc9ffd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158923:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158930:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca004 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158935:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca004 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158940:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612903.158943:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca004 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158958:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca004 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158966:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9612c93f7c00) 00010000:00010000:2.0:1788612903.158968:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612903.158971:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca004 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.158977:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca004 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.159003:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031000/0x1f8616bf0bc9ff6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227e7 expref: 8 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.159018:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca00b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227e7 expref: 7 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.159025:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9611c76e7b00) 00010000:00010000:2.0:1788612903.159027:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788612903.159029:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0030e00, rc 0) 00000100:00100000:2.0:1788612903.159098:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+7:18710:x1875495914466432:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 647us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612903.159105:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:1.0:1788612903.166163:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612903.171848:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914466560 00000100:00100000:3.0:1788612903.171863:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914466560 00000100:00100000:3.0:1788612903.171927:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:3.0:1788612903.171937:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+5:18710:x1875495914466560:12345-192.168.203.30@tcp:900:lfs.0 00000100:00100000:3.0:1788612903.172038:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+5:18710:x1875495914466560:12345-192.168.203.30@tcp:900:lfs.0 Request processed in 101us (5884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612903.172045:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:3.0:1788612903.176186:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612903.176358:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914466816 00000100:00100000:2.0:1788612903.176368:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914466816 00000100:00100000:2.0:1788612903.176430:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:2.0:1788612903.176440:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+7:18710:x1875495914466816:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788612903.176460:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612903.176537:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca012 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d227ee expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612903.176632:0:22756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788612903.176747:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca012 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227ee expref: 9 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.176762:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612fb832000) 00010000:00010000:2.0:1788612903.176765:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788612903.176771:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca012 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227ee expref: 9 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.176785:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0030200, rc 0) 00000100:00100000:2.0:1788612903.176849:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+8:18710:x1875495914466816:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 409us (672us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788612903.176856:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:2.0:1788612903.182420:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612903.182620:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914467072 00000100:00100000:3.0:1788612903.182630:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914467072 00000100:00100000:3.0:1788612903.182687:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:3.0:1788612903.182708:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+8:18710:x1875495914467072:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:3.0:1788612903.182764:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612903.182790:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca00b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227e7 expref: 8 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612903.182831:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9611c76e7b00) 00010000:00010000:3.0:1788612903.182836:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612903.182859:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca020 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612903.182871:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca020 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612903.182881:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca020 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788612903.183065:0:22758:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f38557a9 reply state 0000000086c431e2 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca020 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612903.183078:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca020 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612903.183084:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9611c76e7b00) 00010000:00010000:3.0:1788612903.183087:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788612903.183089:0:22758:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788612903.183096:0:22758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788612903.183183:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+9:18710:x1875495914467072:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 476us (772us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788612903.183191:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:3.0:1788612903.198197:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612903.198352:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914467328 00000100:00100000:1.0:1788612903.198363:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914467328 00000100:00100000:1.0:1788612903.198419:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:1.0:1788612903.198428:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+9:18710:x1875495914467328:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1788612903.199037:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+10:18710:x1875495914467328:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 607us (846us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788612903.199046:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:0.0:1788612903.213673:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612903.213813:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914467584 00000100:00100000:1.0:1788612903.213823:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914467584 00000100:00100000:1.0:1788612903.213931:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:1.0:1788612903.213943:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+10:18710:x1875495914467584:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612903.213979:0:24230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612903.214000:0:24230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca027 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d227f5 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214074:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca02e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214089:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca02e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214100:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca02e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214111:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca035 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214117:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca035 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214142:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca035 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612903.214253:0:24230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788612903.214346:0:24230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca02e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214354:0:24230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca02e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214360:0:24230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca02e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214376:0:24230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612903.214380:0:24230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca02e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214387:0:24230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca02e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214399:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612fb832000) 00010000:00010000:1.0:1788612903.214402:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612903.214406:0:24230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca02e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214412:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca02e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214425:0:24230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca035 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214430:0:24230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca035 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214435:0:24230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca035 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214440:0:24230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612903.214443:0:24230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca035 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214448:0:24230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca035 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214467:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9612c93f7c00) 00010000:00010000:1.0:1788612903.214470:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612903.214473:0:24230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca035 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214739:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca035 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214777:0:24230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca027 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227f5 expref: 12 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214787:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612fb832000) 00010000:00010000:1.0:1788612903.214789:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788612903.214793:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca027 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227f5 expref: 12 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.214803:0:24230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240400, rc 0) 00000100:00100000:1.0:1788612903.214857:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+11:18710:x1875495914467584:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 917us (1194us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1788612903.214864:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 34 00000040:00080000:0.0:1788612903.216703:0:23512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788612903.220666:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612903.220735:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914467712 00000100:00100000:1.0:1788612903.220744:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914467712 00000100:00100000:1.0:1788612903.220798:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:1.0:1788612903.220808:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+11:18710:x1875495914467712:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612903.220833:0:25550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612903.220853:0:25550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca043 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d227fc expref: -99 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.220968:0:25550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bca04a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.220982:0:25550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bca04a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.220993:0:25550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bca04a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612903.221018:0:25550:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788612903.221021:0:25550:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788612903.221038:0:25550:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bca04a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.221062:0:25550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca043 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227fc expref: 13 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.221080:0:25550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bca04a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227fc expref: 12 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.221088:0:25550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9611c76e7b00) 00010000:00010000:1.0:1788612903.221091:0:25550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788612903.221095:0:25550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240800, rc 0) 00000100:00100000:0.0:1788612903.222403:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+12:18710:x1875495914467712:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1519us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612903.222415:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:0.0:1788612903.241871:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612903.242089:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914467840 00000100:00100000:2.0:1788612903.242107:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914467840 00000100:00100000:1.0:1788612903.242360:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:1.0:1788612903.242373:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+12:18710:x1875495914467840:12345-192.168.203.30@tcp:37:lfs.0 00000100:00100000:1.0:1788612903.252147:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+12:18710:x1875495914467840:12345-192.168.203.30@tcp:37:lfs.0 Request processed in 9766us (10273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612903.252174:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:3.0:1788612903.256528:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612903.256642:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914468096 00000100:00100000:2.0:1788612903.256655:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914468096 00000100:00100000:2.0:1788612903.256730:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:2.0:1788612903.256741:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c18a1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+12:18710:x1875495914468096:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1788612903.256945:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c18a1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+13:18710:x1875495914468096:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 205us (482us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788612903.256953:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00010000:00010000:3.0:1788612903.283398:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788612903.322596:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612903.322868:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914468224 00000100:00100000:2.0:1788612903.322890:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914468224 00000100:00100000:2.0:1788612903.322954:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:2.0:1788612903.322964:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+11:18716:x1875495914468224:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1788612903.322982:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612903.323003:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca051 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22803 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323060:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca058 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323072:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca058 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323083:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca058 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323093:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca05f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323100:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca05f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323106:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca05f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323170:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031000/0x1f8616bf0bca066 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323178:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031000/0x1f8616bf0bca066 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323184:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031000/0x1f8616bf0bca066 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612903.323220:0:22757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788612903.323224:0:22757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788612903.323258:0:22757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031000/0x1f8616bf0bca066 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323270:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca058 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323276:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca058 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323282:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca058 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323288:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612903.323306:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca058 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323314:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca058 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323328:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612fb832000) 00010000:00010000:2.0:1788612903.323340:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612903.323345:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca058 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323351:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca058 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323365:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca05f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323382:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca05f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323387:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca05f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323392:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612903.323394:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca05f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323400:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca05f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323408:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9612c93f7c00) 00010000:00010000:2.0:1788612903.323410:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612903.323413:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca05f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323419:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca05f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323444:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca051 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22803 expref: 13 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323458:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031000/0x1f8616bf0bca066 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22803 expref: 12 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.323465:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9611c76e7b00) 00010000:00010000:2.0:1788612903.323467:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788612903.323535:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0031000, rc 0) 00000100:00100000:2.0:1788612903.323602:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+12:18716:x1875495914468224:12345-192.168.203.30@tcp:101:bash.0 Request processed in 638us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612903.323610:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:3.0:1788612903.332445:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612903.332644:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914468352 00000100:00100000:1.0:1788612903.332659:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914468352 00000100:00100000:1.0:1788612903.332732:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:1.0:1788612903.332742:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:18716:x1875495914468352:12345-192.168.203.30@tcp:900:bash.0 00000100:00100000:1.0:1788612903.332833:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:18716:x1875495914468352:12345-192.168.203.30@tcp:900:bash.0 Request processed in 91us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612903.332841:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:0.0:1788612903.340773:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612903.340904:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914468608 00000100:00100000:1.0:1788612903.340918:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914468608 00000100:00100000:1.0:1788612903.340995:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:1.0:1788612903.341009:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+12:18716:x1875495914468608:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1788612903.341034:0:24230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612903.341063:0:24230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca06d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2280a expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.341223:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca074 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.341242:0:24230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bca04a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227fc expref: 12 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.341252:0:24230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca074 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.341307:0:24230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bca04a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227fc expref: 12 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.341352:0:24230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bca04a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227fc expref: 12 pid: 25550 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612903.341369:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc726a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24230:1875495932403840:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612903.341523:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c133a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788612903.346077:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc726a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24230:1875495932403840:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612903.346135:0:24230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca074 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612903.347678:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612903.348516:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914468736 00000100:00100000:3.0:1788612903.348550:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914468736 00010000:00010000:3.0:1788612903.348660:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bca04a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227fc expref: 13 pid: 25550 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612903.349428:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:3.0:1788612903.349443:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+13:2395:x1875495914468736:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612903.349464:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612903.349636:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bca04a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227fc expref: 13 pid: 25550 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612903.349656:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bca04a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227fc expref: 13 pid: 25550 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612903.349890:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240800/0x1f8616bf0bca04a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d227fc expref: 13 pid: 25550 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612903.349914:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9611c76e7b00) 00010000:00010000:3.0:1788612903.349920:0:22741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca074 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612903.349934:0:22741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca074 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612903.349943:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca074 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612903.349983:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612903.350065:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+12:2395:x1875495914468736:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 625us (2396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612903.350089:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00010000:00010000:1.0:1788612903.351066:0:24230:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca074 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.351079:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca074 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.351125:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca07b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.351138:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca07b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.351148:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca07b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.354611:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bca082 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.354635:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bca082 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.354663:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bca082 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612903.354676:0:24230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788612903.354985:0:24230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca074 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.354995:0:24230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca074 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.355003:0:24230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca074 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.355010:0:24230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612903.355016:0:24230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca074 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.355025:0:24230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca074 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.355044:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9611c76e7b00) 00010000:00010000:1.0:1788612903.355047:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788612903.355053:0:24230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca074 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.355060:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca074 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788612903.355077:0:24230:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1b92f6f reply state 00000000e316467c transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca07b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.355099:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca07b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.355106:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9612fb832e00) 00010000:00010000:1.0:1788612903.355109:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788612903.355112:0:24230:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788612903.355164:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca06d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2280a expref: 15 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.355182:0:24230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bca082 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2280a expref: 14 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.355190:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:1.0:1788612903.355193:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788612903.355195:0:24230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240e00, rc 0) 00000100:00100000:1.0:1788612903.355368:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+15:18716:x1875495914468608:12345-192.168.203.30@tcp:101:bash.0 Request processed in 14360us (14608us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788612903.355385:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:0.0:1788612903.364852:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612903.366246:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914468864 00000100:00100000:2.0:1788612903.366267:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914468864 00000100:00100000:2.0:1788612903.366514:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:2.0:1788612903.366529:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+15:18716:x1875495914468864:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1788612903.366562:0:25550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612903.366592:0:25550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca090 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22811 expref: -99 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.366685:0:25550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca097 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.366704:0:25550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca097 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.366721:0:25550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca097 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612903.366784:0:25550:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788612903.366789:0:25550:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788612903.366814:0:25550:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca097 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.366827:0:25550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca097 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.366858:0:25550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca090 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22811 expref: 17 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.366905:0:25550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca097 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22811 expref: 16 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.366916:0:25550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:2.0:1788612903.366919:0:25550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612903.366923:0:25550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0030200, rc 0) 00000100:00100000:2.0:1788612903.367014:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+16:18716:x1875495914468864:12345-192.168.203.30@tcp:101:bash.0 Request processed in 489us (2178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612903.367022:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:1.0:1788612903.376042:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612903.376338:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914469120 00000100:00100000:2.0:1788612903.376353:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914469120 00000100:00100000:2.0:1788612903.376529:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:2.0:1788612903.376543:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+16:18716:x1875495914469120:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:2.0:1788612903.377213:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+17:18716:x1875495914469120:12345-192.168.203.30@tcp:35:bash.0 Request processed in 670us (1180us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1788612903.377223:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:3.0:1788612903.497966:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612903.498120:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914469376 00000100:00100000:1.0:1788612903.498134:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914469376 00000100:00100000:1.0:1788612903.498217:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:1.0:1788612903.498230:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+17:18726:x1875495914469376:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612903.498258:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612903.498284:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca09e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22818 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612903.498453:0:22756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788612903.498651:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca09e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22818 expref: 19 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.498669:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612fb832000) 00010000:00010000:1.0:1788612903.498673:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788612903.498680:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca09e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22818 expref: 19 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.498696:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241c00, rc 0) 00000100:00100000:1.0:1788612903.498787:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+18:18726:x1875495914469376:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 559us (837us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1788612903.498795:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:0.0:1788612903.506460:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612903.506594:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914469632 00000100:00100000:1.0:1788612903.506607:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914469632 00000100:00100000:1.0:1788612903.506670:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:1.0:1788612903.506682:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+18:18726:x1875495914469632:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1788612903.506990:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+19:18726:x1875495914469632:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 309us (542us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788612903.507000:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:2.0:1788612903.579877:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612903.580013:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914469888 00000100:00100000:1.0:1788612903.580026:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914469888 00000100:00100000:1.0:1788612903.580106:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:1.0:1788612903.580118:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+19:18730:x1875495914469888:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788612903.580171:0:24230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612903.580217:0:24230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca0ac lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2281f expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.580370:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca0b3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.580389:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca0b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.580404:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca0b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612903.580417:0:24230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788612903.581095:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca0ac lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2281f expref: 22 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.581119:0:24230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca0b3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2281f expref: 21 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.581268:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:1.0:1788612903.581272:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612903.581276:0:24230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240400, rc 0) 00000100:00100000:1.0:1788612903.582313:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+21:18730:x1875495914469888:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 2190us (2441us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1788612903.582326:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:3.0:1788612903.589004:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612903.589131:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612903.589252:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914470144 00000100:00100000:2.0:1788612903.589265:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914470144 00000100:00100000:2.0:1788612903.589365:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:2.0:1788612903.589376:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+21:2397:x1875495914470144:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612903.589394:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612903.589429:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca0b3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2281f expref: 21 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612903.589538:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:2.0:1788612903.589553:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612903.589625:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+20:2397:x1875495914470144:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 250us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612903.589633:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:0.0:1788612903.590981:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914470016 00000100:00100000:0.0:1788612903.590995:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914470016 00000100:00100000:0.0:1788612903.593394:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:0.0:1788612903.593427:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fccc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+20:18730:x1875495914470016:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:0.0:1788612903.593758:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bca0c1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612903.593779:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bca0c1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612903.593793:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bca0c1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612903.594063:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bca0c1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612903.594070:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bca0c1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612903.594075:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bca0c1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612903.594079:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612903.594083:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bca0c1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612903.594089:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bca0c1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612903.594102:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:0.0:1788612903.594105:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788612903.594110:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bca0c1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612903.594116:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896600/0x1f8616bf0bca0c1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612903.594355:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fccc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+20:18730:x1875495914470016:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 942us (5365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612903.594364:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:3.0:1788612903.600995:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612903.601156:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914470400 00000100:00100000:2.0:1788612903.601180:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914470400 00000100:00100000:2.0:1788612903.601258:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1788612903.601271:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+20:18730:x1875495914470400:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1788612903.602008:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+21:18730:x1875495914470400:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 735us (1027us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1788612903.602017:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000040:00080000:1.0:1788612903.667031:0:22790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788612903.920784:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788612903.920815:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932403968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788612903.920913:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612903.920979:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932403968 00000100:00100000:3.0:1788612903.920988:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932403968 00000100:00100000:3.0:1788612903.921062:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788612903.921071:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932403968:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788612903.921315:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788612903.921411:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788612903.921503:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875495932403968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 433us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612903.921510:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788612903.921951:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6b44f55-8b88-4406-a946-d178714afb91:3649:1875495932404096:0@lo:400:kworker.0 00000100:00100000:1.0:1788612903.921995:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612903.922051:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932404608:0@lo:400:kworker.0 00000100:00100000:1.0:1788612903.922079:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612903.922110:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932405120:0@lo:400:kworker.0 00000100:00100000:1.0:1788612903.922138:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612903.922305:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932404480:0@lo:400:kworker.0 00000100:00100000:0.0:1788612903.922339:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612903.922368:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932404992:0@lo:400:kworker.0 00000100:00100000:0.0:1788612903.922392:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612903.922394:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932404224:0@lo:400:kworker.0 00000100:00100000:0.0:1788612903.922409:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932405504:0@lo:400:kworker.0 00000100:00100000:2.0:1788612903.922425:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612903.922426:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612903.922444:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932404736:0@lo:400:kworker.0 00000100:00100000:0.0:1788612903.922447:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788612903.922453:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932405632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788612903.922467:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612903.922472:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612903.922499:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932405248:0@lo:400:kworker.0 00000100:00100000:0.0:1788612903.922513:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932404608 00000100:00100000:0.0:1788612903.922519:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932404608 00000100:00100000:0.0:1788612903.922554:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932404224 00000100:00100000:0.0:1788612903.922557:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932404224 00000100:00100000:0.0:1788612903.922573:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788612903.922581:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932404608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612903.922649:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612903.922674:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788612903.922689:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fc724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932404352:0@lo:400:kworker.0 00000100:00100000:1.0:1788612903.922785:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875495932403968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612903.922820:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788612903.922828:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932404224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612903.922867:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932404224:12345-0@lo:400:kworker.0 Request processed in 40us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612903.922874:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788612903.922900:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932405120 00000100:00100000:1.0:1788612903.922904:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932405120 00000100:00080000:1.0:1788612903.922922:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612903.922944:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932404480 00000100:00100000:1.0:1788612903.922947:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932404480 00000100:00100000:1.0:1788612903.922959:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932404992 00000100:00100000:1.0:1788612903.922961:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932404992 00000100:00100000:2.0:1788612903.922970:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612903.922971:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932405504 00000100:00100000:1.0:1788612903.922973:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932405504 00000100:00080000:1.0:1788612903.922985:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788612903.922992:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932404864:0@lo:400:kworker.0 00000100:00100000:1.0:1788612903.922998:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932405248 00000100:00100000:1.0:1788612903.923000:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932405248 00000100:00080000:1.0:1788612903.923010:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788612903.923016:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612903.923024:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788612903.923029:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932405120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612903.923043:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932405376:0@lo:400:kworker.0 00000100:00100000:1.0:1788612903.923066:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875495932405120:12345-0@lo:400:kworker.0 Request processed in 36us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612903.923070:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612903.923072:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788612903.923087:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932404224:0@lo:400:kworker.0 00000100:00100000:2.0:1788612903.923110:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932404096 00000100:00100000:2.0:1788612903.923114:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932404096 00000100:00100000:2.0:1788612903.923321:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788612903.923328:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:3649:x1875495932404096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612903.923363:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b44f55-8b88-4406-a946-d178714afb91+24:3649:x1875495932404096:12345-0@lo:400:kworker.0 Request processed in 35us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612903.923369:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788612903.923399:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932404736 00000100:00100000:2.0:1788612903.923402:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932404736 00000100:00100000:2.0:1788612903.923430:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932404352 00000100:00100000:2.0:1788612903.923433:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932404352 00000100:00100000:2.0:1788612903.923450:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932404864 00000100:00100000:2.0:1788612903.923453:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932404864 00000100:00100000:2.0:1788612903.923466:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788612903.923471:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932404736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612903.923646:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932404736:12345-0@lo:400:kworker.0 Request processed in 172us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612903.923654:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788612903.923667:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788612903.923674:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932404352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612903.924070:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932404352:12345-0@lo:400:kworker.0 Request processed in 396us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612903.924077:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788612903.924089:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788612903.924105:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932404864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612903.924436:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875495932405120:0@lo:400:kworker.0 00000100:00100000:1.0:1788612903.924465:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6b44f55-8b88-4406-a946-d178714afb91:3649:1875495932404096:0@lo:400:kworker.0 00000100:00080000:1.0:1788612903.924495:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788612903.924499:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612903.924510:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932405376 00000100:00100000:1.0:1788612903.924515:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932405376 00000100:00080000:1.0:1788612903.924535:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788612903.924559:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788612903.924567:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932404480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612903.924986:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788612903.925000:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612e9545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932405760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788612903.925113:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932404864:12345-0@lo:400:kworker.0 Request processed in 1008us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612903.925119:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932404480:12345-0@lo:400:kworker.0 Request processed in 553us (2779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612903.925126:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788612903.925171:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932404480:0@lo:400:kworker.0 00000100:00100000:1.0:1788612903.925197:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788612903.925205:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932404992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612903.925242:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875495932404992:12345-0@lo:400:kworker.0 Request processed in 39us (2849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612903.925248:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788612903.925272:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875495932404992:0@lo:400:kworker.0 00000100:00100000:1.0:1788612903.925301:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788612903.925310:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932405504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612903.925344:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875495932405504:12345-0@lo:400:kworker.0 Request processed in 37us (2917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612903.925350:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788612903.925374:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7b4ca80 x1875495932405504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612903.925398:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875495932405504:0@lo:400:kworker.0 00000100:00100000:1.0:1788612903.925417:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788612903.925423:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612c8ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932405248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612903.925456:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612c8ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875495932405248:12345-0@lo:400:kworker.0 Request processed in 33us (2928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612903.925462:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788612903.925490:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788612903.925498:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932405376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612903.925528:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875495932405376:12345-0@lo:400:kworker.0 Request processed in 31us (2457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612903.925534:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788612903.925579:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932405632 00000100:00100000:1.0:1788612903.925585:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932405632 00000100:00100000:0.0:1788612903.925880:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932404608:12345-0@lo:400:kworker.0 Request processed in 3297us (3798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612903.925891:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788612903.925937:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932404608:0@lo:400:kworker.0 00000100:00100000:1.0:1788612903.928014:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788612903.928038:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932405632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788612903.928078:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788612903.930097:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788612903.930226:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fc724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932404352:0@lo:400:kworker.0 00000100:00100000:2.0:1788612903.930245:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932404864:0@lo:400:kworker.0 00000100:00100000:2.0:1788612903.930259:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875495932405376:0@lo:400:kworker.0 00000100:00100000:2.0:1788612903.930273:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932404736:0@lo:400:kworker.0 00010000:00080000:2.0:1788612903.930300:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9611c7b4f100 x1875495932405248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788612903.930302:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932405632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1576us (7128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612903.930313:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875495932405248:0@lo:400:kworker.0 00000100:00100000:1.0:1788612903.930315:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788612903.930368:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612c8ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932405632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788612903.930928:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612903.931156:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932405760 00000100:00100000:0.0:1788612903.931174:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932405760 00000100:00100000:0.0:1788612903.931217:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788612903.931227:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932405760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788612903.931254:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788612903.931350:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932405760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612903.931357:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788612903.931546:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612e9545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932405760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788612903.997452:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612903.997836:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914470656 00000100:00100000:1.0:1788612903.997849:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914470656 00000100:00100000:1.0:1788612903.997917:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:1.0:1788612903.997929:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+21:18761:x1875495914470656:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:1.0:1788612903.997974:0:24230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612903.998002:0:24230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca0c8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22826 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.998155:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bca0cf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.998190:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bca0cf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.998210:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bca0cf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612903.998226:0:24230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788612903.998424:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca0c8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22826 expref: 24 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.998449:0:24230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bca0cf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22826 expref: 23 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612903.998459:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:1.0:1788612903.998463:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612903.998468:0:24230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241800, rc 0) 00000100:00100000:1.0:1788612903.998809:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+23:18761:x1875495914470656:12345-192.168.203.30@tcp:101:cat.0 Request processed in 881us (1371us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1788612903.998817:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:0.0:1788612904.005655:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612904.005996:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612904.006153:0:25787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914471040 00000100:00100000:3.0:1788612904.006166:0:25787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914471040 00000100:00080000:0.0:1788612904.006390:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788612904.006460:0:25787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:3.0:1788612904.006508:0:25787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+23:2394:x1875495914471040:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788612904.006542:0:25787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788612904.006576:0:25787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241800/0x1f8616bf0bca0cf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22826 expref: 23 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612904.006600:0:25787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:3.0:1788612904.006606:0:25787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788612904.007105:0:25787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+22:2394:x1875495914471040:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 220us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612904.007117:0:25787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:1.0:1788612904.007664:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914470912 00000100:00100000:1.0:1788612904.007673:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914470912 00000100:00100000:1.0:1788612904.007722:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:1.0:1788612904.007742:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+22:18761:x1875495914470912:12345-192.168.203.30@tcp:35:cat.0 00000100:00100000:1.0:1788612904.008090:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+23:18761:x1875495914470912:12345-192.168.203.30@tcp:35:cat.0 Request processed in 349us (2449us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1788612904.008365:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:3.0:1788612904.129392:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612904.139854:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914471296 00000100:00100000:1.0:1788612904.139879:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914471296 00000100:00100000:1.0:1788612904.139980:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:1.0:1788612904.139993:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+23:18767:x1875495914471296:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788612904.140027:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612904.140055:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca0dd lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2282d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612904.140661:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bca0e4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612904.140681:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bca0e4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612904.140695:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bca0e4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612904.140710:0:22756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788612904.140881:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca0dd lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2282d expref: 26 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612904.140904:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bca0e4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2282d expref: 25 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612904.140937:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:1.0:1788612904.140940:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788612904.140945:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241000, rc 0) 00000100:00100000:1.0:1788612904.141043:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+25:18767:x1875495914471296:12345-192.168.203.30@tcp:101:dd.0 Request processed in 1052us (11662us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1788612904.141052:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:3.0:1788612904.148780:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612904.148827:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612904.148914:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914471552 00000100:00100000:0.0:1788612904.148932:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914471552 00000100:00100000:0.0:1788612904.149041:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:0.0:1788612904.149054:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9544a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+25:2397:x1875495914471552:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612904.149075:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612904.149107:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bca0e4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2282d expref: 25 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.149134:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:0.0:1788612904.149141:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788612904.149245:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914471424 00000100:00100000:1.0:1788612904.149251:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914471424 00000100:00100000:1.0:1788612904.149302:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:1.0:1788612904.149309:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+25:18767:x1875495914471424:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788612904.149333:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612904.149352:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca0f2 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22834 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612904.149390:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bca0f9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612904.149406:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bca0f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612904.149419:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bca0f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612904.149601:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca0f2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22834 expref: 27 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612904.149717:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bca0f9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22834 expref: 26 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612904.149732:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:1.0:1788612904.149736:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788612904.149739:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7240000, rc 0) 00000100:00100000:1.0:1788612904.149804:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+26:18767:x1875495914471424:12345-192.168.203.30@tcp:101:dd.0 Request processed in 494us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612904.149811:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:0.0:1788612904.150402:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9544a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+25:2397:x1875495914471552:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 1349us (1630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612904.150411:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:3.0:1788612904.174040:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612904.193871:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914471808 00000100:00100000:0.0:1788612904.193889:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914471808 00000100:00100000:0.0:1788612904.193957:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:0.0:1788612904.193968:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+25:18767:x1875495914471808:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:0.0:1788612904.194019:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612904.194044:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca097 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22811 expref: 25 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.194065:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:0.0:1788612904.194070:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788612904.194244:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896e00/0x1f8616bf0bca100 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.194259:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896e00/0x1f8616bf0bca100 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.194284:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896e00/0x1f8616bf0bca100 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788612904.194340:0:22757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1788612904.194364:0:22757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9959cdf reply state 000000007ba94f92 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896e00/0x1f8616bf0bca100 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.194375:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896e00/0x1f8616bf0bca100 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.194381:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:0.0:1788612904.194383:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788612904.194386:0:22757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788612904.194543:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+27:18767:x1875495914471808:12345-192.168.203.30@tcp:36:dd.0 Request processed in 575us (20510us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1788612904.194551:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00000020:00080000:0.0:1788612904.194557:0:22757:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788612904.306034:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612904.353088:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612904.357994:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914472064 00000100:00100000:2.0:1788612904.358015:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914472064 00000100:00100000:2.0:1788612904.358114:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:2.0:1788612904.358128:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+27:18767:x1875495914472064:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:2.0:1788612904.358918:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+28:18767:x1875495914472064:12345-192.168.203.30@tcp:35:dd.0 Request processed in 416us (5469us total) trans 12884901907 rc 0/0 00000100:00100000:2.0:1788612904.358932:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:1.0:1788612904.689452:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612904.690764:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914472192 00000100:00100000:0.0:1788612904.690784:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914472192 00000100:00100000:0.0:1788612904.690882:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:0.0:1788612904.690895:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+28:18781:x1875495914472192:12345-192.168.203.30@tcp:101:stat.0 00010000:00010000:0.0:1788612904.690927:0:25550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612904.690956:0:25550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bca107 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2283b expref: -99 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691049:0:25550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca10e lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691328:0:25550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca10e lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691366:0:25550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca10e lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691381:0:25550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca115 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691388:0:25550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca115 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691393:0:25550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca115 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691528:0:25550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bca11c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691539:0:25550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bca11c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691547:0:25550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bca11c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612904.691601:0:25550:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788612904.691607:0:25550:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612904.691659:0:25550:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bca11c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691673:0:25550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bca11c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691684:0:25550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca10e lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691703:0:25550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca10e lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691711:0:25550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca10e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691718:0:25550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612904.691723:0:25550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca10e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691731:0:25550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca10e lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691756:0:25550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9611c76e7b00) 00010000:00010000:0.0:1788612904.691760:0:25550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612904.691765:0:25550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca10e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691771:0:25550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca10e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691786:0:25550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca115 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691792:0:25550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca115 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691799:0:25550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca115 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691803:0:25550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612904.691815:0:25550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca115 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691822:0:25550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca115 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691830:0:25550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9612fb832e00) 00010000:00010000:0.0:1788612904.691833:0:25550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612904.691836:0:25550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca115 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.691842:0:25550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca115 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.692182:0:25550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bca107 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2283b expref: 30 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.692210:0:25550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bca11c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2283b expref: 29 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612904.692218:0:25550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:0.0:1788612904.692221:0:25550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612904.692224:0:25550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897e00, rc 0) 00000100:00100000:0.0:1788612904.692319:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+29:18781:x1875495914472192:12345-192.168.203.30@tcp:101:stat.0 Request processed in 1426us (2881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612904.692327:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:3.0:1788612904.825613:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612904.825828:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914472448 00000100:00100000:1.0:1788612904.825841:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914472448 00000100:00100000:1.0:1788612904.825920:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:1.0:1788612904.825934:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+29:18787:x1875495914472448:12345-192.168.203.30@tcp:36:truncate.0 00010000:00010000:1.0:1788612904.826006:0:24230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788612904.826041:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897e00/0x1f8616bf0bca11c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2283b expref: 29 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612904.826079:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:1.0:1788612904.826086:0:24230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788612904.826332:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca123 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612904.826350:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca123 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612904.826361:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca123 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788612904.826414:0:24230:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:1.0:1788612904.826461:0:24230:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a24ae15e reply state 00000000aacaece2 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca123 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612904.826827:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca123 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612904.826838:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:1.0:1788612904.826841:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788612904.826845:0:24230:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788612904.826993:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+31:18787:x1875495914472448:12345-192.168.203.30@tcp:36:truncate.0 Request processed in 1061us (1395us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1788612904.827002:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 47 00000020:00080000:1.0:1788612904.827008:0:24230:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788612905.068991:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612905.072384:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914472576 00000100:00100000:0.0:1788612905.072404:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914472576 00000100:00100000:0.0:1788612905.072528:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:0.0:1788612905.072541:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+31:18801:x1875495914472576:12345-192.168.203.30@tcp:101:stat.0 00010000:00010000:0.0:1788612905.072589:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612905.072843:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bca12a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22842 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.072933:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca131 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.072953:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca131 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.072967:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca131 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.072980:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca138 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.072988:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca138 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.072995:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca138 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.073085:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca13f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.074260:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca13f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.074272:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca13f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612905.074418:0:22757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1788612905.074438:0:22757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788612905.074469:0:22757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca13f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.074502:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca13f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.074513:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca131 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.074520:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca131 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.074528:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca131 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.074535:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612905.074541:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca131 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.074550:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca131 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.074564:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9611c76e7b00) 00010000:00010000:0.0:1788612905.074567:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612905.074574:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca131 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.074582:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897400/0x1f8616bf0bca131 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.075543:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca138 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.075591:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca138 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.075599:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca138 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.075616:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612905.075624:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca138 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.075633:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca138 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.075653:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9612fb832e00) 00010000:00010000:0.0:1788612905.075656:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612905.075662:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca138 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.075668:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896c00/0x1f8616bf0bca138 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.075734:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bca12a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22842 expref: 33 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.075750:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca13f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22842 expref: 32 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.075756:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:0.0:1788612905.075759:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788612905.075767:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897000, rc 0) 00000100:00100000:0.0:1788612905.076383:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+32:18801:x1875495914472576:12345-192.168.203.30@tcp:101:stat.0 Request processed in 3842us (7403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612905.076392:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:3.0:1788612905.204980:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612905.205101:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914472832 00000100:00100000:0.0:1788612905.205116:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914472832 00000100:00100000:0.0:1788612905.205340:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:0.0:1788612905.205355:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+32:18811:x1875495914472832:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788612905.205376:0:25550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612905.205396:0:25550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bca146 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22849 expref: -99 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788612905.205561:0:25550:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788612905.205659:0:25550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bca146 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22849 expref: 34 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.205673:0:25550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612fb832000) 00010000:00010000:0.0:1788612905.205676:0:25550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788612905.205681:0:25550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bca146 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22849 expref: 34 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.205695:0:25550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897c00, rc 0) 00000100:00100000:0.0:1788612905.205756:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+33:18811:x1875495914472832:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 404us (791us total) trans 12884901910 rc 301/301 00000100:00100000:0.0:1788612905.212030:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:3.0:1788612905.219108:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612905.219443:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914473088 00000100:00100000:2.0:1788612905.219452:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914473088 00000100:00100000:2.0:1788612905.219533:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:2.0:1788612905.219542:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c18a0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+33:18811:x1875495914473088:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1788612905.220020:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c18a0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+34:18811:x1875495914473088:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 477us (924us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1788612905.220038:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00010000:00010000:3.0:1788612905.328907:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612905.398848:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612905.399884:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914473344 00000100:00100000:1.0:1788612905.399895:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914473344 00000100:00100000:1.0:1788612905.399963:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:1.0:1788612905.399975:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+34:18817:x1875495914473344:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1788612905.399996:0:24230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612905.400016:0:24230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bca154 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22850 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.400153:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca15b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.400168:0:24230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bca082 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2280a expref: 35 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.400176:0:24230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca13f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22842 expref: 35 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.400197:0:24230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca15b lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.400229:0:24230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca13f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22842 expref: 35 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.400241:0:24230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca13f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22842 expref: 35 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612905.400254:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24230:1875495932405888:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612905.400359:0:24230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bca082 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2280a expref: 35 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.400368:0:24230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bca082 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2280a expref: 35 pid: 24230 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612905.400376:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24230:1875495932406016:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612905.400397:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0dc600 going to sleep for 11 seconds 00000100:00100000:1.0:1788612905.403467:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24230:1875495932405888:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612905.403515:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24230:1875495932406016:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612905.403540:0:24230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca15b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612905.410781:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612905.410827:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612905.411082:0:25787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914473472 00000100:00100000:0.0:1788612905.411100:0:25787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914473472 00010000:00010000:0.0:1788612905.411142:0:25787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca13f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22842 expref: 36 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612905.411192:0:25787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914473600 00000100:00100000:0.0:1788612905.411195:0:25787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914473600 00010000:00010000:0.0:1788612905.411209:0:25787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bca082 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2280a expref: 37 pid: 24230 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612905.411243:0:25787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:0.0:1788612905.411253:0:25787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e97ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+37:2395:x1875495914473472:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612905.411267:0:25787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612905.411274:0:25787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca13f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22842 expref: 37 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.411298:0:25787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca13f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22842 expref: 37 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.411320:0:25787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca13f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22842 expref: 37 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.411344:0:25787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:0.0:1788612905.411350:0:25787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca15b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.411358:0:25787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca15b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.411365:0:25787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612905.411663:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:2.0:1788612905.411676:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9546300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+36:2395:x1875495914473600:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612905.411685:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612905.411691:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bca082 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2280a expref: 36 pid: 24230 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.411701:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bca082 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2280a expref: 36 pid: 24230 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.411713:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240e00/0x1f8616bf0bca082 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2280a expref: 36 pid: 24230 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.411724:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:2.0:1788612905.411728:0:22741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca15b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.411736:0:22741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca15b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.411743:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca15b lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.411765:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612905.411789:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9546300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+35:2395:x1875495914473600:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 118us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612905.411796:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:0.0:1788612905.412065:0:25787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e97ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+36:2395:x1875495914473472:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 165us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612905.412408:0:25787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00010000:00010000:1.0:1788612905.412507:0:24230:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca15b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.412537:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca15b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612905.412556:0:24230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1788612905.412704:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bca154 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22850 expref: 36 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.412720:0:24230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca15b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22850 expref: 35 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.412727:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:1.0:1788612905.412729:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788612905.412732:0:24230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241600, rc 0) 00000100:00100000:1.0:1788612905.412770:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+35:18817:x1875495914473344:12345-192.168.203.30@tcp:101:bash.0 Request processed in 12798us (13932us total) trans 12884901912 rc 0/0 00000100:00100000:1.0:1788612905.412776:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:3.0:1788612905.418050:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612905.418367:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914473856 00000100:00100000:0.0:1788612905.418376:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914473856 00000100:00100000:0.0:1788612905.418439:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:0.0:1788612905.418449:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+34:18817:x1875495914473856:12345-192.168.203.30@tcp:36:bash.0 00010000:00010000:0.0:1788612905.419052:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bca169 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.419070:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bca169 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.421545:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bca169 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788612905.421647:0:22757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:0.0:1788612905.421692:0:22757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b172ed76 reply state 000000002427a43c transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bca169 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.421708:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bca169 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.421716:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:0.0:1788612905.421719:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788612905.421723:0:22757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788612905.421863:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+37:18817:x1875495914473856:12345-192.168.203.30@tcp:36:bash.0 Request processed in 3411us (3817us total) trans 12884901914 rc 0/0 00000100:00100000:0.0:1788612905.421872:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 51 00000020:00080000:0.0:1788612905.421877:0:22757:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788612905.426962:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612905.427266:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914473984 00000100:00100000:0.0:1788612905.427297:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914473984 00000100:00100000:0.0:1788612905.427357:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:0.0:1788612905.427367:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+37:18817:x1875495914473984:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1788612905.427391:0:25550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612905.427656:0:25550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca170 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22857 expref: -99 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.427719:0:25550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca170 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22857 expref: 38 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.427734:0:25550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca170 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22857 expref: 38 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.427753:0:25550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:0.0:1788612905.427756:0:25550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788612905.427760:0:25550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897000, rc 0) 00000100:00100000:0.0:1788612905.427820:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+38:18817:x1875495914473984:12345-192.168.203.30@tcp:101:bash.0 Request processed in 455us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612905.427828:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:3.0:1788612905.438173:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612905.438242:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914474112 00000100:00100000:1.0:1788612905.438251:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914474112 00000100:00100000:1.0:1788612905.438324:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:1.0:1788612905.438334:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+38:18817:x1875495914474112:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1788612905.438354:0:24230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612905.438376:0:24230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bca177 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2285e expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.438464:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bca17e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.438535:0:24230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca15b lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22850 expref: 39 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.438544:0:24230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bca17e lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.438578:0:24230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca15b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22850 expref: 39 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.438591:0:24230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca15b lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22850 expref: 39 pid: 24230 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788612905.438605:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24230:1875495932406144:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788612905.438696:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612ec0dc600 going to sleep for 11 seconds 00000100:00100000:1.0:1788612905.442617:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24230:1875495932406144:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788612905.442646:0:24230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bca17e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612905.443928:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612905.444096:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914474240 00000100:00100000:2.0:1788612905.444105:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914474240 00010000:00010000:2.0:1788612905.444141:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca15b lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22850 expref: 40 pid: 24230 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612905.444184:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:2.0:1788612905.444194:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9545c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+40:2394:x1875495914474240:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612905.444208:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612905.444215:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca15b lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22850 expref: 40 pid: 24230 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.444227:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca15b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22850 expref: 40 pid: 24230 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.444248:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca15b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22850 expref: 40 pid: 24230 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.444265:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:2.0:1788612905.444270:0:22741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bca17e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.444289:0:22741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bca17e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.444298:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bca17e lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.444329:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788612905.446206:0:24230:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bca17e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.446221:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bca17e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788612905.446284:0:24230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788612905.446289:0:24230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788612905.446317:0:24230:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bca17e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.446354:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bca177 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2285e expref: 40 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.446373:0:24230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bca17e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2285e expref: 39 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.446539:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:3.0:1788612905.446542:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788612905.446546:0:24230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241000, rc 0) 00000100:00100000:2.0:1788612905.446799:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9545c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+39:2394:x1875495914474240:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 2603us (2874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612905.446826:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:3.0:1788612905.456959:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+38:18817:x1875495914474112:12345-192.168.203.30@tcp:101:bash.0 Request processed in 18615us (18783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612905.456973:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:1.0:1788612905.487409:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612905.487656:0:25787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914474496 00000100:00100000:0.0:1788612905.487666:0:25787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914474496 00000100:00100000:0.0:1788612905.487735:0:25787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:0.0:1788612905.487745:0:25787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+38:18817:x1875495914474496:12345-192.168.203.30@tcp:103:bash.0 00010000:00010000:0.0:1788612905.487761:0:25787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788612905.487786:0:25787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca170 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22857 expref: 38 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.487830:0:25787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bca17e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2285e expref: 37 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.487841:0:25787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:0.0:1788612905.487847:0:25787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612905.487898:0:25787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+36:18817:x1875495914474496:12345-192.168.203.30@tcp:103:bash.0 Request processed in 155us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612905.487905:0:25787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:0.0:1788612905.489829:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612905.489912:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914474624 00000100:00100000:1.0:1788612905.489920:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914474624 00000100:00100000:1.0:1788612905.489971:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:1.0:1788612905.489980:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+36:18817:x1875495914474624:12345-192.168.203.30@tcp:58:bash.0 00010000:00010000:1.0:1788612905.490073:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca185 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.490102:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca185 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.490124:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca185 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788612905.494656:0:22757:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788612905.494693:0:22757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1788612905.494835:0:22757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1788612905.494937:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+36:18817:x1875495914474624:12345-192.168.203.30@tcp:58:bash.0 Request processed in 4953us (5110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612905.494948:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:1.0:1788612905.498377:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612905.498524:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914474752 00000100:00100000:0.0:1788612905.498534:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914474752 00000100:00100000:0.0:1788612905.498658:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:0.0:1788612905.498668:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+36:18817:x1875495914474752:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1788612905.498686:0:25550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612905.498706:0:25550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca18c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22865 expref: -99 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.498765:0:25550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca185 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.498777:0:25550:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca18c lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22865 expref: 37 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.498804:0:25550:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca185 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.498817:0:25550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca18c lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22865 expref: 37 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.498828:0:25550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:0.0:1788612905.498831:0:25550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788612905.498835:0:25550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca18c lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22865 expref: 37 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.498843:0:25550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897000, rc 0) 00000100:00100000:0.0:1788612905.498948:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+37:18817:x1875495914474752:12345-192.168.203.30@tcp:101:bash.0 Request processed in 282us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612905.498955:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 55 00000040:00080000:0.0:1788612905.711848:0:22790:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788612905.711857:0:22790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788612905.711880:0:22790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788612905.711892:0:22790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788612905.712030:0:22790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fcb46d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22790:1875495932406272:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788612905.714501:0:22790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea3bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788612905.733578:0:22790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fcb46d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22790:1875495932406272:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788612905.734816:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612905.739329:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914474880 00000100:00100000:3.0:1788612905.739344:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914474880 00000100:00100000:3.0:1788612905.739575:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:3.0:1788612905.739587:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+37:18818:x1875495914474880:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788612905.739618:0:24230:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788612905.741396:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+37:18818:x1875495914474880:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 1802us (6577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612905.742306:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:0.0:1788612905.756859:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612905.759882:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914475008 00000100:00100000:2.0:1788612905.759896:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914475008 00000100:00100000:2.0:1788612905.760003:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:2.0:1788612905.760013:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+37:18818:x1875495914475008:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788612905.760093:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca193 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760109:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca193 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760123:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca193 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760147:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca19a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760155:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca19a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760162:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca19a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760182:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1a1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760191:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760197:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612905.760253:0:22757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788612905.760257:0:22757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788612905.760271:0:22757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760290:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca193 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760296:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca193 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760302:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca193 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760307:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612905.760311:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca193 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760318:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca193 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760329:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9611c66e5200) 00010000:00010000:2.0:1788612905.760332:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612905.760337:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca193 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760343:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca193 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760357:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca19a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760373:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca19a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760379:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca19a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760383:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612905.760386:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca19a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760392:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca19a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760400:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9612c93f7100) 00010000:00010000:2.0:1788612905.760403:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612905.760405:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca19a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760412:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca19a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760439:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760445:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1a1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760451:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1a1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760455:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612905.760465:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1a1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760471:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1a1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760519:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:2.0:1788612905.760522:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612905.760525:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1a1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.760530:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1a1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612905.761056:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+37:18818:x1875495914475008:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 1041us (4202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612905.761065:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:0.0:1788612905.766453:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612905.766984:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914475264 00000100:00100000:1.0:1788612905.766993:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914475264 00000100:00100000:1.0:1788612905.767049:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:1.0:1788612905.767058:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+37:18818:x1875495914475264:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788612905.767248:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788612905.767270:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bca1a8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2286c expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.767379:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca1af lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.767395:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca1af lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.767406:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca1af lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788612905.767498:0:22756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788612905.767820:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca1af lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.767828:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca1af lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.767835:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca1af lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.767852:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:1.0:1788612905.767856:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca1af lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.767864:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca1af lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.767876:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:1.0:1788612905.767879:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788612905.767884:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca1af lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.767890:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241600/0x1f8616bf0bca1af lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.767930:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bca1a8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2286c expref: 39 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.767938:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9611c66e5200) 00010000:00010000:1.0:1788612905.767940:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788612905.767942:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241000/0x1f8616bf0bca1a8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2286c expref: 39 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.767949:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c7241000, rc 0) 00000100:00100000:1.0:1788612905.768003:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+38:18818:x1875495914475264:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 946us (1559us total) trans 12884901915 rc 301/301 00000100:00100000:1.0:1788612905.768011:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:3.0:1788612905.772699:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612905.772886:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914475392 00000100:00100000:1.0:1788612905.772905:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914475392 00000100:00100000:1.0:1788612905.772954:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:1.0:1788612905.772963:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+38:18818:x1875495914475392:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788612905.773002:0:24230:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788612905.773577:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+38:18818:x1875495914475392:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 613us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612905.773586:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:3.0:1788612905.779081:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612905.779165:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914475648 00000100:00100000:2.0:1788612905.779174:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914475648 00000100:00100000:2.0:1788612905.779232:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:2.0:1788612905.779242:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+38:18818:x1875495914475648:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788612905.779260:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612905.779290:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1bd lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22873 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788612905.779698:0:22757:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =60 00000004:00080000:2.0:1788612905.779704:0:22757:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+60 in llog 00000004:00080000:2.0:1788612905.779725:0:22757:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1788612905.779865:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca1c4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.779896:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca1c4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.779907:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca1c4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.779959:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1bd lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22873 expref: 41 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.779977:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca1c4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22873 expref: 40 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.779985:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9612c93f7100) 00010000:00010000:2.0:1788612905.779988:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788612905.779991:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c0030e00, rc 0) 00000100:00100000:2.0:1788612905.780942:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+40:18818:x1875495914475648:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1697us (1873us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1788612905.780952:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:3.0:1788612905.787361:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612905.787969:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914475904 00000100:00100000:2.0:1788612905.787978:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914475904 00000100:00100000:2.0:1788612905.788027:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:2.0:1788612905.788035:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+40:18818:x1875495914475904:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788612905.789313:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612905.789344:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030e00/0x1f8616bf0bca1c4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22873 expref: 40 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789367:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9612c93f7100) 00010000:00010000:2.0:1788612905.789384:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612905.789404:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1d2 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789566:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1d2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789578:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1d2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789593:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca1d9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x1bf7a696 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789600:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca1d9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1bf7a696 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789606:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca1d9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1bf7a696 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789649:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1d2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789655:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1d2 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789661:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1d2 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789676:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612905.789685:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1d2 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789692:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1d2 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789705:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9611c76e7b00) 00010000:00010000:2.0:1788612905.789708:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612905.789712:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1d2 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789718:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030a00/0x1f8616bf0bca1d2 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789726:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca1d9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1bf7a696 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789740:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca1d9 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1bf7a696 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789746:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca1d9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1bf7a696 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789752:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0030200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612905.789754:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca1d9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1bf7a696 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789761:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca1d9 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1bf7a696 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789768:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x1bf7a696 (ffff9612c93f7b00) 00010000:00010000:2.0:1788612905.789770:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612905.789773:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca1d9 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x1bf7a696 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.789779:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0030200/0x1f8616bf0bca1d9 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x1bf7a696 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612905.789878:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+39:18818:x1875495914475904:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 1842us (2525us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788612905.789886:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:0.0:1788612905.795525:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612905.796350:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914476032 00000100:00100000:3.0:1788612905.796361:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914476032 00000100:00100000:3.0:1788612905.796423:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:3.0:1788612905.796433:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+39:18818:x1875495914476032:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788612905.796451:0:24230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788612905.796472:0:24230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca1e0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2287a expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.796538:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bca1e7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.796812:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bca1e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.796826:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bca1e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.796927:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca1e0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2287a expref: 41 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.796943:0:24230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36c00/0x1f8616bf0bca1e7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2287a expref: 40 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.796952:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9611c76e7000) 00010000:00010000:3.0:1788612905.796959:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788612905.796963:0:24230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612f7b36c00, rc 0) 00000100:00100000:3.0:1788612905.797103:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+40:18818:x1875495914476032:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 671us (1629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612905.797111:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:3.0:1788612905.806976:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612905.807318:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914476288 00000100:00100000:2.0:1788612905.807328:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914476288 00000100:00100000:2.0:1788612905.807393:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:2.0:1788612905.807404:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+40:18818:x1875495914476288:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788612905.807532:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2c00/0x1f8616bf0bca1ee lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.807824:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2c00/0x1f8616bf0bca1ee lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.807840:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2c00/0x1f8616bf0bca1ee lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788612905.807999:0:22757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:2.0:1788612905.808009:0:22757:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 720191532351ns, next at 721191530031ns, rc = 0 00000004:00010000:2.0:1788612905.808056:0:22757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000efd07e86 reply state 00000000760ace70 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2c00/0x1f8616bf0bca1ee lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.808068:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2c00/0x1f8616bf0bca1ee lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.808359:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9611c76e7000) 00010000:00010000:2.0:1788612905.808363:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788612905.808367:0:22757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788612905.808708:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+42:18818:x1875495914476288:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 1303us (1737us total) trans 12884901917 rc 0/0 00000100:00100000:2.0:1788612905.808740:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:2.0:1788612905.813374:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612905.814952:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914476416 00000100:00100000:3.0:1788612905.814964:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914476416 00000100:00100000:2.0:1788612905.816327:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:2.0:1788612905.816339:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+42:18818:x1875495914476416:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788612905.816363:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612905.816384:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca1f5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22881 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.816459:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca1f5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22881 expref: 43 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.816508:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca1f5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22881 expref: 43 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.816528:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9611c76e7000) 00010000:00010000:2.0:1788612905.816532:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788612905.816535:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3c00, rc 0) 00000100:00100000:2.0:1788612905.816975:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+43:18818:x1875495914476416:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 636us (3608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612905.816983:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:0.0:1788612905.820449:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612905.820690:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914476544 00000100:00100000:2.0:1788612905.820699:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914476544 00000100:00080000:0.0:1788612905.820887:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788612905.820931:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1788612905.820943:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:2394:x1875495914476544:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788612905.821191:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:2394:x1875495914476544:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 250us (750us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1788612905.821211:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:3.0:1788612905.825049:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612905.825589:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914476800 00000100:00100000:1.0:1788612905.825599:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914476800 00000100:00100000:1.0:1788612905.825671:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:1.0:1788612905.825682:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+43:18818:x1875495914476800:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788612905.825905:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+44:18818:x1875495914476800:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 225us (866us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1788612905.825913:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:3.0:1788612905.835542:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612905.836017:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914477056 00000100:00100000:1.0:1788612905.836027:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914477056 00000100:00100000:1.0:1788612905.836090:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:1.0:1788612905.836099:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+44:18818:x1875495914477056:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788612905.836201:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+44:18818:x1875495914477056:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 103us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612905.836208:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:0.0:1788612905.843690:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612905.843849:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914477184 00000100:00100000:2.0:1788612905.843861:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914477184 00000100:00100000:2.0:1788612905.843935:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:2.0:1788612905.843946:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+44:18818:x1875495914477184:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788612905.843967:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612905.843991:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bca1fc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22888 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.844063:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3400/0x1f8616bf0bca203 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.844089:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3400/0x1f8616bf0bca203 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.844099:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3400/0x1f8616bf0bca203 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612905.844231:0:22757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788612905.844250:0:22757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3400/0x1f8616bf0bca203 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.844286:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bca1fc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22888 expref: 46 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.844304:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3400/0x1f8616bf0bca203 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22888 expref: 45 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.844312:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9611c76e7000) 00010000:00010000:2.0:1788612905.844326:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788612905.844329:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3400, rc 0) 00000100:00100000:2.0:1788612905.844390:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+45:18818:x1875495914477184:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 445us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612905.844397:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:2.0:1788612905.850906:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612905.850997:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914477312 00000100:00100000:0.0:1788612905.851007:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914477312 00000100:00100000:0.0:1788612905.851064:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:0.0:1788612905.851320:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+6:2395:x1875495914477312:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788612905.851339:0:24265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788612905.851364:0:24265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f12cdbd/0x1f8616bf0bca20a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2288f expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788612905.851391:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c1129, blocks: 0x0 00010000:00010000:0.0:1788612905.851411:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=720s v=(0 0) 00010000:00010000:0.0:1788612905.854281:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612905.854297:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f12cdbd/0x1f8616bf0bca20a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2288f expref: 7 pid: 24265 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.854328:0:24265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002f12cdbd/0x1f8616bf0bca20a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2288f expref: 7 pid: 24265 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.854344:0:24265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9612c2897400, rc 0) 00000100:00100000:0.0:1788612905.855010:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+7:2395:x1875495914477312:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 3933us (4108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612905.855020:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:3.0:1788612905.860211:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612905.860576:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914477568 00000100:00100000:2.0:1788612905.860586:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914477568 00000100:00100000:2.0:1788612905.860650:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:2.0:1788612905.860661:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+45:18818:x1875495914477568:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788612905.861361:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+45:18818:x1875495914477568:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 699us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612905.861370:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:3.0:1788612905.865097:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612905.865399:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914477696 00000100:00100000:0.0:1788612905.865410:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914477696 00000100:00100000:0.0:1788612905.865515:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:0.0:1788612905.865538:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+45:18818:x1875495914477696:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788612905.868290:0:22736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:2.0:1788612905.868306:0:22736:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788612905.868375:0:22736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:1.0:1788612905.868566:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788612905.868584:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932406400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788612905.868651:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612905.868697:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932406400 00000100:00100000:1.0:1788612905.868714:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932406400 00000100:00100000:1.0:1788612905.868777:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788612905.868785:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932406400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788612905.868899:0:24266:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788612905.868903:0:24266:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788612905.868905:0:24266:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788612905.868907:0:24266:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788612905 -> 1788612905 00002000:00010000:1.0:1788612905.868910:0:24266:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788612905.868948:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875495932406400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 164us (297us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788612905.868955:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788612905.868991:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788612905.869021:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9611c7b4c700/2, rc 0, transno 12884901892 00000100:00100000:1.0:1788612905.869026:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932406400:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1788612905.870080:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca020 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.870100:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca020 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.870108:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca020 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.870114:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612905.870118:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca020 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.870300:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca020 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.870318:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9611c76e7b00) 00010000:00010000:3.0:1788612905.870321:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788612905.870336:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca020 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.870343:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca020 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.870671:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fcc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.870680:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fcc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.870686:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.870692:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c0031a00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612905.870695:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.870701:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fcc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.870711:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9612c93f7c00) 00010000:00010000:0.0:1788612905.870713:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612905.870717:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fcc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.870722:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c0031a00/0x1f8616bf0bc9fcc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871053:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc9fd3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871061:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc9fd3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871067:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc9fd3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871232:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612905.871235:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc9fd3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871241:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc9fd3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871250:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9611c76e7b00) 00010000:00010000:0.0:1788612905.871252:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612905.871255:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc9fd3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871260:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bc9fd3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871282:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca07b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871289:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca07b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871296:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca07b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871301:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241200 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612905.871303:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca07b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871309:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca07b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871325:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9612fb832e00) 00010000:00010000:0.0:1788612905.871328:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612905.871331:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca07b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871337:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241200/0x1f8616bf0bca07b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871352:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896e00/0x1f8616bf0bca100 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871357:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896e00/0x1f8616bf0bca100 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871363:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896e00/0x1f8616bf0bca100 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871367:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2896e00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612905.871370:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896e00/0x1f8616bf0bca100 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871376:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896e00/0x1f8616bf0bca100 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871383:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:0.0:1788612905.871385:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612905.871388:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896e00/0x1f8616bf0bca100 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.871393:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2896e00/0x1f8616bf0bca100 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612905.872325:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+17:18818:x1875495914477696:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 6782us (7246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612905.872336:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00010000:00010000:0.0:1788612905.872405:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca123 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872424:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca123 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872430:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca123 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872436:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612905.872439:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca123 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872447:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca123 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872458:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:0.0:1788612905.872461:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612905.872464:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca123 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872470:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241c00/0x1f8616bf0bca123 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872500:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bca169 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872507:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bca169 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872512:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bca169 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872528:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c2897c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612905.872531:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bca169 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872536:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bca169 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872544:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:0.0:1788612905.872557:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788612905.872560:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bca169 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872567:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897c00/0x1f8616bf0bca169 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872579:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2c00/0x1f8616bf0bca1ee lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872585:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2c00/0x1f8616bf0bca1ee lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872590:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2c00/0x1f8616bf0bca1ee lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872595:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:0.0:1788612905.872597:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2c00/0x1f8616bf0bca1ee lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872602:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2c00/0x1f8616bf0bca1ee lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872620:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9611c76e7000) 00010000:00010000:0.0:1788612905.872623:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788612905.872626:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2c00/0x1f8616bf0bca1ee lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.872631:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2c00/0x1f8616bf0bca1ee lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612905.877042:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612905.877133:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914477824 00000100:00100000:2.0:1788612905.877149:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914477824 00000100:00100000:2.0:1788612905.877209:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:2.0:1788612905.877219:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612ffaf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+7:2394:x1875495914477824:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788612905.878052:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612ffaf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+7:2394:x1875495914477824:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 832us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612905.878061:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:0.0:1788612905.883951:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612905.884258:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914478080 00000100:00100000:2.0:1788612905.884268:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914478080 00000100:00100000:2.0:1788612905.884338:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:2.0:1788612905.884348:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+14:18818:x1875495914478080:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788612905.884401:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612905.884437:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3400/0x1f8616bf0bca203 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22888 expref: 14 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.884457:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9611c76e7000) 00010000:00010000:2.0:1788612905.884462:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612905.884514:0:22757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bca211 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.884527:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bca211 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.884538:0:22757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bca211 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788612905.884884:0:22757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003d138f6 reply state 0000000053689873 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bca211 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.884898:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3800/0x1f8616bf0bca211 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.884905:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9611c76e7000) 00010000:00010000:2.0:1788612905.884908:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788612905.884911:0:22757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788612905.885004:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+15:18818:x1875495914478080:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 657us (1063us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1788612905.885028:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:0.0:1788612905.888951:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612905.889016:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914478208 00000100:00100000:2.0:1788612905.889025:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914478208 00000100:00100000:2.0:1788612905.889076:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:2.0:1788612905.889096:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+7:18818:x1875495914478208:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788612905.889113:0:24265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612905.889136:0:24265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bca218 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d22896 expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.889164:0:24265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002f12cdbd/0x1f8616bf0bca20a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2288f expref: 8 pid: 24265 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.889172:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612905.889176:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612905.889181:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bca218 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22896 expref: 8 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.889213:0:24265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002f12cdbd/0x1f8616bf0bca20a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2288f expref: 8 pid: 24265 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.889226:0:24265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002f12cdbd/0x1f8616bf0bca20a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2288f expref: 8 pid: 24265 timeout: 820 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612905.889239:0:24265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24265:1875495932406528:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788612905.889321:0:24265:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e02a6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612905.893974:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612905.894056:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914478336 00000100:00100000:0.0:1788612905.894065:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914478336 00010000:00010000:0.0:1788612905.894118:0:22743:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002f12cdbd/0x1f8616bf0bca20a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2288f expref: 9 pid: 24265 timeout: 820 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612905.894168:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:0.0:1788612905.894177:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+9:2394:x1875495914478336:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612905.894190:0:22743:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612905.894212:0:22743:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002f12cdbd/0x1f8616bf0bca20a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2288f expref: 9 pid: 24265 timeout: 820 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.894227:0:22743:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002f12cdbd/0x1f8616bf0bca20a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2288f expref: 9 pid: 24265 timeout: 820 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.894251:0:22743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612905.894256:0:22743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788612905.894262:0:22743:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bca218 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22896 expref: 9 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.894294:0:22743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bca218 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22896 expref: 9 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.894329:0:22743:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bca218 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22896 expref: 9 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612905.894343:0:22743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fcb45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22743:1875495932406656:192.168.203.30@tcp:105: 00000100:00100000:0.0:1788612905.894422:0:22743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea3bf00 going to sleep for 11 seconds 00010000:00010000:2.0:1788612905.895041:0:24265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f12cdbd/0x1f8616bf0bca20a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2288f expref: 9 pid: 24265 timeout: 820 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612905.895058:0:24265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24265:1875495932406528:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612905.895097:0:24265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bca218 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22896 expref: 8 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.895109:0:24265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a2400, rc 0) 00000100:00100000:2.0:1788612905.895161:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+8:18818:x1875495914478208:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 6065us (6218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612905.895168:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:0.0:1788612905.900045:0:22743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fcb45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22743:1875495932406656:192.168.203.30@tcp:105: 00010000:00010000:0.0:1788612905.900092:0:22743:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788612905.900153:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+7:2394:x1875495914478336:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 5977us (6187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612905.900162:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:0.0:1788612905.903270:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612905.903371:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914478464 00000100:00100000:1.0:1788612905.903380:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914478464 00000100:00100000:1.0:1788612905.903439:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:1.0:1788612905.903449:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fcb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+7:2395:x1875495914478464:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788612905.903642:0:24851:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788612905.903646:0:24851:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788612905 00002000:00010000:1.0:1788612905.903648:0:24851:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788612903 00002000:00010000:1.0:1788612905.903650:0:24851:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788612905 -> 1788612905 00002000:00010000:1.0:1788612905.903652:0:24851:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788612905.903718:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fcb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+8:2395:x1875495914478464:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 270us (456us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788612905.903726:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:1.0:1788612905.907043:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612905.907298:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914478592 00000100:00100000:2.0:1788612905.907309:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914478592 00000100:00100000:2.0:1788612905.907370:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:2.0:1788612905.907380:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+8:2397:x1875495914478592:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788612905.907435:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000036870f8f/0x1f8616bf0bca21f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.907453:0:24264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bca218 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22896 expref: 8 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.907461:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612905.907465:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788612905.907469:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036870f8f/0x1f8616bf0bca21f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.907556:0:24264:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bca218 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22896 expref: 8 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.907569:0:24264:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bca218 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22896 expref: 8 pid: 24265 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612905.907583:0:24264:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24264:1875495932406784:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788612905.907661:0:24264:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e02a6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612905.910867:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788612905.911123:0:25787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914478720 00000100:00100000:0.0:1788612905.911140:0:25787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914478720 00010000:00010000:0.0:1788612905.911175:0:25787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bca218 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22896 expref: 9 pid: 24265 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612905.911215:0:25787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:0.0:1788612905.911225:0:25787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+9:2394:x1875495914478720:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788612905.911241:0:25787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788612905.911264:0:25787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bca218 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22896 expref: 9 pid: 24265 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.911306:0:25787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bca218 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22896 expref: 9 pid: 24265 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.911329:0:25787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788612905.911333:0:25787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788612905.911339:0:25787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000036870f8f/0x1f8616bf0bca21f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.911349:0:25787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036870f8f/0x1f8616bf0bca21f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788612905.911368:0:25787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788612905.911837:0:24264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6d0838a/0x1f8616bf0bca218 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22896 expref: 9 pid: 24265 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612905.911856:0:24264:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24264:1875495932406784:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788612905.911875:0:24264:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000036870f8f/0x1f8616bf0bca21f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.911887:0:24264:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000036870f8f/0x1f8616bf0bca21f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.911894:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036870f8f/0x1f8616bf0bca21f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.911915:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000036870f8f/0x1f8616bf0bca21f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.911936:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036870f8f/0x1f8616bf0bca21f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.911943:0:24264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036870f8f/0x1f8616bf0bca21f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.911950:0:24264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3400 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:2.0:1788612905.911954:0:24264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036870f8f/0x1f8616bf0bca21f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.911962:0:24264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036870f8f/0x1f8616bf0bca21f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.911972:0:24264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036870f8f/0x1f8616bf0bca21f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.911978:0:24264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036870f8f/0x1f8616bf0bca21f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788612905.912075:0:25787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+8:2394:x1875495914478720:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 850us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612905.912091:0:25787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:2.0:1788612905.913335:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+7:2397:x1875495914478592:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 5949us (6294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612905.913345:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:3.0:1788612905.915985:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612905.916065:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914478976 00000100:00100000:2.0:1788612905.916074:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914478976 00000100:00100000:2.0:1788612905.916142:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:2.0:1788612905.916163:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+15:18818:x1875495914478976:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788612905.916239:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bca226 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.916257:0:22758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bca0f9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22834 expref: 15 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.916267:0:22758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bca226 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.916308:0:22758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bca0f9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22834 expref: 15 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.916321:0:22758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bca0f9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22834 expref: 15 pid: 22758 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612905.916334:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed58700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22758:1875495932406912:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788612905.916412:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e02a6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612905.919525:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed58700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22758:1875495932406912:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612905.919561:0:22758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bca226 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612905.920108:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612905.920265:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914479104 00000100:00100000:2.0:1788612905.920272:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914479104 00010000:00010000:2.0:1788612905.920317:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bca0f9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22834 expref: 16 pid: 22758 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612905.920352:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:2.0:1788612905.920361:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+16:2394:x1875495914479104:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612905.920375:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612905.920382:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bca0f9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22834 expref: 16 pid: 22758 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.920409:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bca0f9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22834 expref: 16 pid: 22758 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.920444:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240000/0x1f8616bf0bca0f9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22834 expref: 16 pid: 22758 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.920460:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:2.0:1788612905.920466:0:22741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca18c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22865 expref: 15 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.920497:0:22741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bca226 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.920504:0:22741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bca226 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.920511:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bca226 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.920532:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612905.920706:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+15:2394:x1875495914479104:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 345us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612905.920715:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00010000:00010000:3.0:1788612905.921046:0:22758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bca226 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.921055:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bca226 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.921252:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca22d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.921266:0:22758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca1f5 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22881 expref: 15 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.921283:0:22758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca22d lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.921312:0:22758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca1f5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22881 expref: 15 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.921336:0:22758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca1f5 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22881 expref: 15 pid: 22758 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612905.921349:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8e5d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22758:1875495932407040:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788612905.921403:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c92f99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612905.925919:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8e5d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22758:1875495932407040:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788612905.925948:0:22758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca22d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612905.928242:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612905.928342:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914479232 00000100:00100000:2.0:1788612905.928352:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914479232 00010000:00010000:2.0:1788612905.928394:0:22742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca1f5 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22881 expref: 16 pid: 22758 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612905.928467:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:2.0:1788612905.928509:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e97ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+16:2395:x1875495914479232:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788612905.928523:0:22742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788612905.928530:0:22742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca1f5 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22881 expref: 16 pid: 22758 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.928542:0:22742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca1f5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22881 expref: 16 pid: 22758 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.928574:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca1f5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22881 expref: 16 pid: 22758 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.928591:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9611c76e7000) 00010000:00010000:2.0:1788612905.928598:0:22742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca22d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.928610:0:22742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca22d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.928617:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca22d lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.928646:0:22742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788612905.928950:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e97ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+15:2395:x1875495914479232:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 472us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612905.928958:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00010000:00010000:3.0:1788612905.930377:0:22758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca22d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.930391:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca22d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788612905.930559:0:22758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:3.0:1788612905.930689:0:22758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:3.0:1788612905.930723:0:22758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:3.0:1788612905.930815:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8e5d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22758:1875495932407168:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788612905.930877:0:22758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612905.930905:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612c92f90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788612905.931811:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932407168 00000100:00100000:1.0:1788612905.931821:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932407168 00000100:00100000:1.0:1788612905.931872:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788612905.931882:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22758:x1875495932407168:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788612905.931991:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22758:x1875495932407168:12345-0@lo:1000:mdt00_002.0 Request processed in 110us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612905.931999:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788612905.932252:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8e5d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22758:1875495932407168:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788612905.932433:0:22758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:0.0:1788612905.932535:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb853b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22758:1875495932407296:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788612905.932779:0:22758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612905.932805:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612fea3b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788612905.932857:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932407296 00000100:00100000:1.0:1788612905.932862:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932407296 00000100:00100000:1.0:1788612905.932898:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788612905.932906:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22758:x1875495932407296:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788612905.933026:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22758:x1875495932407296:12345-0@lo:1000:mdt00_002.0 Request processed in 120us (246us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1788612905.933032:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788612905.933115:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb853b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22758:1875495932407296:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788612905.933161:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca22d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.933170:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca22d lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.933177:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca22d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.933182:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612905.933186:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca22d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.933193:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca22d lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.933208:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9611c76e7000) 00010000:00010000:2.0:1788612905.933211:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788612905.933215:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca22d lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.933220:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca22d lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.933247:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca185 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.933253:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca185 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.933258:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca185 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.933282:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7240400 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612905.933285:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca185 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.933292:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca185 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.933300:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:2.0:1788612905.933303:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788612905.933309:0:22758:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca18c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22865 expref: 18 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.933320:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca18c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22865 expref: 18 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.933330:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca18c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22865 expref: 18 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.933382:0:22758:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9612c2897000/0x1f8616bf0bca18c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d22865 expref: 18 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612905.933393:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22758:1875495932407424:192.168.203.30@tcp:105: 00000100:00100000:2.0:1788612905.933463:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff9612e02a6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788612905.937169:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612905.937257:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22758:1875495932407424:192.168.203.30@tcp:105: 00010000:00010000:2.0:1788612905.937293:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca185 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.937320:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7240400/0x1f8616bf0bca185 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.937351:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca234 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.937365:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca234 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.937376:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca234 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.937387:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca234 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.937394:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca234 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.937400:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca234 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.937405:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a3c00 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612905.937409:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca234 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.937429:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca234 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.937439:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:2.0:1788612905.937443:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788612905.937446:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca234 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.937458:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca234 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.937469:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bca226 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.937518:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bca226 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.937524:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bca226 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.937529:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9611c67a2800 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:2.0:1788612905.937532:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bca226 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.937538:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bca226 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.937709:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:2.0:1788612905.937713:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788612905.937717:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bca226 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.937723:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bca226 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788612905.937881:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+18:18818:x1875495914478976:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 21719us (21903us total) trans 12884901924 rc 0/0 00000100:00100000:2.0:1788612905.937892:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 70 00000020:00080000:2.0:1788612905.937904:0:22758:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788612905.938114:0:22790:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788612905.938119:0:22790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788612905.938134:0:22790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788612905.938141:0:22790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788612905.938243:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914479360 00000100:00100000:1.0:1788612905.938250:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914479360 00000100:00100000:1.0:1788612905.938300:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:1.0:1788612905.938310:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+18:18817:x1875495914479360:12345-192.168.203.30@tcp:49:bash.0 00000100:00100000:1.0:1788612905.938395:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+18:18817:x1875495914479360:12345-192.168.203.30@tcp:49:bash.0 Request processed in 88us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612905.938402:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:1.0:1788612905.942469:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612905.942755:0:24265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914479488 00000100:00100000:2.0:1788612905.942764:0:24265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914479488 00000100:00100000:2.0:1788612905.942817:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:2.0:1788612905.942826:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+7:18817:x1875495914479488:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1788612905.942842:0:24265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612905.942862:0:24265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036870f8f/0x1f8616bf0bca23b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d2289d expref: -99 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788612905.943229:0:24265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9c1129, atime: 0x6a9c1127, ctime: 0x6a9c1129, blocks: 0x0 00010000:00010000:2.0:1788612905.943251:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=720s v=(0 0) 00010000:00010000:2.0:1788612905.943256:0:24265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788612905.943266:0:24265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036870f8f/0x1f8616bf0bca23b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2289d expref: 8 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.943294:0:24265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000036870f8f/0x1f8616bf0bca23b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d2289d expref: 8 pid: 24265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.943307:0:24265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3400, rc 0) 00000100:00100000:2.0:1788612905.943365:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+8:18817:x1875495914479488:12345-192.168.203.30@tcp:101:bash.0 Request processed in 539us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612905.943372:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:3.0:1788612905.946264:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612905.946643:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914479744 00000100:00100000:1.0:1788612905.946653:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914479744 00000100:00100000:1.0:1788612905.946715:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:1.0:1788612905.946725:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+18:18818:x1875495914479744:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788612905.946990:0:22760:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788612905.947019:0:22760:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:1.0:1788612905.947052:0:22760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bca242 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.947087:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bca242 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.947100:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bca242 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.947109:0:22760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bca242 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.947115:0:22760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bca242 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.947121:0:22760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bca242 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788612905.947144:0:22760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788612905.947231:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+20:18818:x1875495914479744:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 507us (976us total) trans 12884901926 rc 0/0 00000100:00100000:1.0:1788612905.947238:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00000020:00080000:1.0:1788612905.947243:0:22760:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788612905.949262:0:22745:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788612905.949285:0:22745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bca242 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.949313:0:22745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612c7241a00 already unused, calling callback (ffffffffc0c3f4f0) 00010000:00010000:3.0:1788612905.949317:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bca242 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.949327:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bca242 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.949343:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9611c76e7000) 00010000:00010000:3.0:1788612905.949346:0:22745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788612905.949350:0:22745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bca242 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.949356:0:22745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612c7241a00/0x1f8616bf0bca242 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612905.949371:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612905.949373:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788612905.949375:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612905.951638:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612905.951862:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914479872 00000100:00100000:2.0:1788612905.951872:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914479872 00000100:00100000:2.0:1788612905.951929:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:2.0:1788612905.951939:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+20:18817:x1875495914479872:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1788612905.951959:0:25550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612905.951992:0:25550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bca249 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d228a4 expref: -99 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.952026:0:25550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca250 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.952040:0:25550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca250 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.952051:0:25550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca250 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.952378:0:25550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2800/0x1f8616bf0bca249 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d228a4 expref: 22 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.952398:0:25550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a3c00/0x1f8616bf0bca250 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d228a4 expref: 21 pid: 25550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612905.952408:0:25550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:2.0:1788612905.953022:0:25550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788612905.953028:0:25550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a3c00, rc 0) 00000100:00100000:2.0:1788612905.953792:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+21:18817:x1875495914479872:12345-192.168.203.30@tcp:101:bash.0 Request processed in 1850us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612905.953801:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:0.0:1788612905.958589:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612905.959080:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914480128 00000100:00100000:1.0:1788612905.959096:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914480128 00000100:00100000:1.0:1788612905.959151:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:1.0:1788612905.959161:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+21:18817:x1875495914480128:12345-192.168.203.30@tcp:35:bash.0 00000001:00080000:1.0:1788612905.959425:0:22760:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000100:00100000:1.0:1788612905.960196:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+23:18817:x1875495914480128:12345-192.168.203.30@tcp:35:bash.0 Request processed in 1033us (1613us total) trans 12884901928 rc 0/0 00000100:00100000:1.0:1788612905.960206:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000020:00080000:1.0:1788612905.960211:0:22760:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788612906.092825:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612906.093024:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914480384 00000100:00100000:2.0:1788612906.093034:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914480384 00000100:00100000:2.0:1788612906.093129:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:2.0:1788612906.093140:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+23:18828:x1875495914480384:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788612906.093162:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788612906.093194:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bca257 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe49eb2cba4d228ab expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788612906.093296:0:22757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788612906.093384:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bca257 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d228ab expref: 25 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788612906.093399:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9612fb832000) 00010000:00010000:2.0:1788612906.093402:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788612906.093407:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9611c67a2400/0x1f8616bf0bca257 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xe49eb2cba4d228ab expref: 25 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788612906.093509:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788612906.093794:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9611c67a2400, rc 0) 00000100:00100000:2.0:1788612906.093849:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+24:18828:x1875495914480384:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 711us (1033us total) trans 12884901929 rc 301/301 00000100:00100000:2.0:1788612906.093856:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:2.0:1788612906.098597:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788612906.098680:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914480512 00000100:00100000:3.0:1788612906.098689:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914480512 00000100:00100000:3.0:1788612906.098751:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:3.0:1788612906.098761:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+24:18828:x1875495914480512:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:3.0:1788612906.098824:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca265 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.098839:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca265 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.098865:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca265 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.098881:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca26c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.098887:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca26c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.098893:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca26c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.098959:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bca273 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.098968:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bca273 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.098974:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bca273 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788612906.099016:0:22758:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bca273 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099027:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca265 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099033:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca265 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099040:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca265 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099055:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36000 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612906.099059:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca265 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099067:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca265 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099095:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9611c76e7b00) 00010000:00010000:3.0:1788612906.099098:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612906.099103:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca265 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099108:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36000/0x1f8616bf0bca265 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099121:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca26c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099127:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca26c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099132:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca26c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099136:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b36600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612906.099138:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca26c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099144:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca26c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099160:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9611c76e7600) 00010000:00010000:3.0:1788612906.099162:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612906.099165:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca26c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099171:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b36600/0x1f8616bf0bca26c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099186:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bca273 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099192:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bca273 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099197:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bca273 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099203:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9612f7b37600 already unused, calling callback (ffffffffc184d4f0) 00010000:00010000:3.0:1788612906.099206:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bca273 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099211:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bca273 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099218:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9612fb832d00) 00010000:00010000:3.0:1788612906.099220:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788612906.099224:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bca273 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788612906.099229:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9612f7b37600/0x1f8616bf0bca273 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788612906.099314:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+24:18828:x1875495914480512:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 554us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612906.099322:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:0.0:1788612906.103815:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612906.104102:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914480768 00000100:00100000:2.0:1788612906.104111:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914480768 00000100:00100000:2.0:1788612906.104166:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:2.0:1788612906.104176:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fb852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+24:18828:x1875495914480768:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1788612906.104404:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fb852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+25:18828:x1875495914480768:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 229us (598us total) trans 12884901930 rc 0/0 00000100:00100000:2.0:1788612906.105143:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00010000:00010000:3.0:1788612906.351780:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612906.479948:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932407552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788612906.480017:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612906.480126:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932407552 00000100:00100000:3.0:1788612906.480134:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932407552 00000100:00100000:3.0:1788612906.480202:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788612906.480213:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932407552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788612906.480243:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788612906.480297:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875495932407552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612906.480305:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788612906.480405:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788612906.480447:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875495932407552:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788612907.382419:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788612907.504624:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788612907.504648:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932407680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788612907.504712:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612907.504767:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932407680 00000100:00100000:3.0:1788612907.504774:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932407680 00000100:00100000:3.0:1788612907.504821:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788612907.504829:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c8e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932407680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788612907.504862:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788612907.504903:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c8e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875495932407680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612907.504910:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788612907.504953:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932407680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788612907.508057:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788612907.508102:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932407808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612907.508186:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788612907.509842:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932407808 00000100:00100000:0.0:1788612907.509854:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932407808 00000100:00100000:0.0:1788612907.509928:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788612907.509938:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932407808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788612907.509973:0:22762:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788612907.510064:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932407808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612907.510084:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788612907.510600:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932407808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788612908.121060:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612908.121096:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612908.121125:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612908.121143:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612908.121293:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612908.121316:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612908.121333:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612908.121349:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612908.121369:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612908.121393:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914481280 00000100:00100000:2.0:1788612908.121402:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914481280 00000100:00100000:2.0:1788612908.121456:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914481792 00000100:00100000:2.0:1788612908.121460:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914481792 00000100:00100000:2.0:1788612908.121473:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914481408 00000100:00100000:0.0:1788612908.121589:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914481024 00000100:00100000:0.0:1788612908.121594:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914481024 00000100:00100000:0.0:1788612908.121627:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914481536 00000100:00100000:0.0:1788612908.121629:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914481536 00000100:00100000:0.0:1788612908.121642:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914481152 00000100:00100000:0.0:1788612908.121644:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914481152 00000100:00100000:0.0:1788612908.121655:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914481664 00000100:00100000:0.0:1788612908.121657:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914481664 00000100:00100000:0.0:1788612908.121671:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:0.0:1788612908.121680:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+25:2397:x1875495914481024:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612908.121819:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+25:2397:x1875495914481024:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 140us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612908.121827:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:0.0:1788612908.121848:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:0.0:1788612908.121854:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:2397:x1875495914481536:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612908.121884:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+6:2397:x1875495914481536:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612908.121889:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:0.0:1788612908.121913:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:0.0:1788612908.121919:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:2397:x1875495914481152:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612908.121946:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:2397:x1875495914481152:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612908.121952:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:0.0:1788612908.121963:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:0.0:1788612908.121970:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+5:2397:x1875495914481664:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788612908.121994:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+5:2397:x1875495914481664:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612908.122000:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:2.0:1788612908.122640:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914481408 00000100:00100000:2.0:1788612908.122669:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914481920 00000100:00100000:2.0:1788612908.122672:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914481920 00000100:00100000:2.0:1788612908.122689:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:2.0:1788612908.122695:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:2397:x1875495914481280:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612908.122895:0:25248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:3.0:1788612908.122914:0:25248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+5:2397:x1875495914481792:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:0.0:1788612908.127224:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788612908.127237:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788612908.127241:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788612908.127243:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788612908.127334:0:24265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:0.0:1788612908.127358:0:24265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+8:2397:x1875495914481408:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612908.127553:0:24264:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:1.0:1788612908.127564:0:24264:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00000100:00100000:3.0:1788612908.132455:0:25248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+5:2397:x1875495914481792:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 9531us (11298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612908.132469:0:25248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:3.0:1788612908.132533:0:25248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:3.0:1788612908.132547:0:25248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+5:2397:x1875495914481920:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788612908.132589:0:25248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:85c43ba8-70ea-4b49-9ede-8fbb9c68d254+5:2397:x1875495914481920:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 48us (11218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612908.132597:0:25248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:1.0:1788612908.136968:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914480896 00000100:00100000:1.0:1788612908.136982:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914480896 00000100:00100000:1.0:1788612908.137046:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 165 00000100:00100000:1.0:1788612908.137056:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e90acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+13:2397:x1875495914480896:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788612908.137128:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e90acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a495520c-d9bc-4ce5-bb68-b6caa50213a1+13:2397:x1875495914480896:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 73us (15835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612908.137136:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 165 00000100:00100000:2.0:1788612908.144675:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+5:2397:x1875495914481280:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 21965us (23563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612908.144691:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:0.0:1788612908.145116:0:24265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+8:2397:x1875495914481408:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 17767us (23777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788612908.145124:0:24265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000001:02000400:1.0:1788612908.308535:0:25842:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1788612908.423688:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788612909.039715:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788612909.039737:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c7b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932408064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788612909.039802:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612909.039844:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9611c8e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932407936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788612909.039867:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788612909.039982:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932408064 00000100:00100000:2.0:1788612909.039984:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932407936 00000100:00100000:3.0:1788612909.039990:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932408064 00000100:00100000:2.0:1788612909.039990:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932407936 00000100:00100000:2.0:1788612909.040034:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612909.040042:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932407936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788612909.040087:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788612909.040129:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875495932407936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612909.040135:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788612909.040158:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6b44f55-8b88-4406-a946-d178714afb91:3649:1875495932408320:0@lo:400:kworker.0 00000100:00100000:1.0:1788612909.040223:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fed5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932408192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788612909.040250:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612909.040286:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932408704:0@lo:400:kworker.0 00000100:00100000:1.0:1788612909.040311:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612909.040329:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fda1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932409216:0@lo:400:kworker.0 00000100:00100000:1.0:1788612909.040350:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788612909.040384:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932408704 00000100:00100000:1.0:1788612909.040387:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932408704 00000100:00100000:1.0:1788612909.040414:0:25550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932409216 00000100:00100000:1.0:1788612909.040417:0:25550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932409216 00000100:00100000:2.0:1788612909.040443:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612909.040495:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932408832:0@lo:400:kworker.0 00000100:00100000:2.0:1788612909.040521:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612909.040538:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fda1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932409344:0@lo:400:kworker.0 00000100:00100000:2.0:1788612909.040559:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612909.040589:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932408320 00000100:00100000:2.0:1788612909.040592:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932408320 00000100:00100000:2.0:1788612909.040617:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788612909.040624:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961301736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+24:3649:x1875495932408320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612909.040658:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961301736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b44f55-8b88-4406-a946-d178714afb91+24:3649:x1875495932408320:12345-0@lo:400:kworker.0 Request processed in 34us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612909.040664:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788612909.040691:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932408832 00000100:00100000:2.0:1788612909.040694:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932408832 00000100:00100000:2.0:1788612909.040720:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788612909.040726:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932408832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612909.040759:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875495932408832:12345-0@lo:400:kworker.0 Request processed in 33us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612909.040765:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788612909.040786:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932408576:0@lo:400:kworker.0 00000100:00100000:2.0:1788612909.040818:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612909.040839:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fda19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932409088:0@lo:400:kworker.0 00000100:00100000:2.0:1788612909.040858:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612909.040874:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961300f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932409600:0@lo:400:kworker.0 00000100:00100000:2.0:1788612909.040898:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612909.040912:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788612909.040918:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fb851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932408448:0@lo:400:kworker.0 00000100:00100000:2.0:1788612909.040938:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612909.040955:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932408960:0@lo:400:kworker.0 00000100:00100000:2.0:1788612909.040974:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612909.040990:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9612fda19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932409472:0@lo:400:kworker.0 00000100:00100000:2.0:1788612909.041007:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788612909.041028:0:25248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932408576 00000100:00100000:2.0:1788612909.041031:0:25248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932408576 00000100:00100000:3.0:1788612909.055312:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932408192 00000100:00100000:3.0:1788612909.055326:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932408192 00000100:00100000:3.0:1788612909.055351:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788612909.055373:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932408064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788612909.055405:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788612909.055515:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875495932408064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (15711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612909.055522:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788612909.055550:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788612909.055557:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3648:x1875495932408192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788612909.055567:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788612909.055612:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3648:x1875495932408192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (15361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612909.055619:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788612909.055655:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932409344 00000100:00100000:3.0:1788612909.055659:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932409344 00000100:00100000:3.0:1788612909.055681:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932409088 00000100:00100000:3.0:1788612909.055683:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932409088 00000100:00100000:3.0:1788612909.055692:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932409600 00000100:00100000:3.0:1788612909.055695:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932409600 00000100:00100000:3.0:1788612909.055705:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932409472 00000100:00100000:3.0:1788612909.055706:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932409472 00000100:00100000:3.0:1788612909.055719:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788612909.055724:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932408704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612909.055757:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875495932408704:12345-0@lo:400:kworker.0 Request processed in 32us (15445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612909.055762:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788612909.055773:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788612909.055778:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932409344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612909.055806:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875495932409344:12345-0@lo:400:kworker.0 Request processed in 28us (15246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612909.055811:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788612909.055821:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788612909.055827:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932409088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612909.055863:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875495932409088:12345-0@lo:400:kworker.0 Request processed in 36us (15004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612909.055869:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788612909.055881:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788612909.055886:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932409600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612909.055910:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875495932409600:12345-0@lo:400:kworker.0 Request processed in 24us (15011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612909.055923:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788612909.055937:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788612909.055942:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fc717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932409472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612909.055973:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fc717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875495932409472:12345-0@lo:400:kworker.0 Request processed in 30us (14964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612909.055978:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788612909.055996:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932408448 00000100:00100000:3.0:1788612909.055999:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932408448 00000100:00100000:3.0:1788612909.056022:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788612909.056028:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932408448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612909.057196:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875495932408448:12345-0@lo:400:kworker.0 Request processed in 31us (15120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612909.057208:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788612909.057262:0:24851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495932408960 00000100:00100000:3.0:1788612909.057268:0:24851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495932408960 00000100:00100000:3.0:1788612909.057310:0:24851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788612909.057317:0:24851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612e9545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932408960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788612909.057386:0:24851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612e9545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875495932408960:12345-0@lo:400:kworker.0 Request processed in 70us (16411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788612909.057392:0:24851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788612909.057439:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932408448:0@lo:400:kworker.0 00000100:00100000:3.0:1788612909.057452:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875495932408960:0@lo:400:kworker.0 00000100:00100000:3.0:1788612909.057463:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fda19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875495932409472:0@lo:400:kworker.0 00000100:00080000:0.0:1788612909.057643:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788612909.057648:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788612909.057650:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788612909.057652:0:22752:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788612909.057712:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c7b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875495932408064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788612909.057726:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9611c8e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875495932407936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788612909.057832:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fed5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875495932408192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788612909.057844:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875495932408704:0@lo:400:kworker.0 00000100:00100000:0.0:1788612909.057883:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fb850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6b44f55-8b88-4406-a946-d178714afb91:3649:1875495932408320:0@lo:400:kworker.0 00000100:00100000:0.0:1788612909.057897:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875495932408832:0@lo:400:kworker.0 00010000:00080000:0.0:1788612909.057910:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9612fda1a300 x1875495932409344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788612909.057920:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fda1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875495932409344:0@lo:400:kworker.0 00000100:00100000:3.0:1788612909.058448:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fda19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875495932409088:0@lo:400:kworker.0 00010000:00080000:3.0:1788612909.058666:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961300f08700 x1875495932409600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788612925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788612909.058678:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961300f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875495932409600:0@lo:400:kworker.0 00000100:00100000:1.0:1788612909.066578:0:25550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788612909.066596:0:25550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9611c7b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932409216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788612909.066693:0:25550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9611c7b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875495932409216:12345-0@lo:400:kworker.0 Request processed in 103us (26341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612909.066700:0:25550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788612909.066715:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fda1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875495932409216:0@lo:400:kworker.0 00000100:00100000:2.0:1788612909.069905:0:25248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788612909.069920:0:25248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fed5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3651:x1875495932408576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788612909.070037:0:25248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fed5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3651:x1875495932408576:12345-0@lo:400:kworker.0 Request processed in 121us (29217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788612909.070044:0:25248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788612909.070590:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9612fccc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875495932408576:0@lo:400:kworker.0 00010000:00010000:3.0:1788612909.424896:0:22745:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788612909.663864:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788612909.663948:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788612909.665631:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914482176 00000100:00100000:1.0:1788612909.665646:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914482176 00000100:00100000:1.0:1788612909.665734:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:1.0:1788612909.665745:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+8:2397:x1875495914482176:12345-192.168.203.30@tcp:16:kworker.0 00000100:00100000:1.0:1788612909.665880:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+8:2397:x1875495914482176:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 136us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788612909.665888:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:0.0:1788612909.668399:0:24269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875495914482048 00000100:00100000:0.0:1788612909.668413:0:24269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875495914482048 00002000:00100000:0.0:1788612909.668603:0:24269:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff9612fd9ab100 x1875495914482048/t0(0) o4->cca74f02-70d3-462b-9a97-5f7e9e5ea7bf@192.168.203.30@tcp:555/0 lens 504/0 e 0 to 0 dl 1788612920 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788612909.668615:0:24269:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9612fd9ab100 with x1875495914482048 ext(0->8) 00002000:00010000:0.0:1788612909.668621:0:24269:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9612fd9ab100 00000100:00100000:0.0:1788612909.669244:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:0.0:1788612909.669266:0:24269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9612fd9ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+8:2397:x1875495914482048:12345-192.168.203.30@tcp:4:bash.0 00000100:00100000:0.0:1788612909.670767:0:24269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9612fd9ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cca74f02-70d3-462b-9a97-5f7e9e5ea7bf+10:2397:x1875495914482048:12345-192.168.203.30@tcp:4:bash.0 Request processed in 1379us (6787us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788612909.670779:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00002000:00100000:0.0:1788612909.670790:0:24269:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff9612fd9ab100 x1875495914482048/t12884901895(0) o4->cca74f02-70d3-462b-9a97-5f7e9e5ea7bf@192.168.203.30@tcp:555/0 lens 504/448 e 0 to 0 dl 1788612920 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788612909.670800:0:24269:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9612fd9ab100 with x1875495914482048 ext(0->8) 00002000:00010000:0.0:1788612909.670807:0:24269:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9612fd9ab100 00000040:00080000:1.0:1788612910.065824:0:22790:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788612910.065832:0:22790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788612910.065853:0:22790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788612910.065861:0:22790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 Debug log: 14431 lines, 14431 kept, 0 dropped, 0 bad.