00000100:00100000:3.0F:1784404955.012303:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729003904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784404955.012387:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404955.012594:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729004032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404955.012624:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404955.012666:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729003904 00000100:00100000:3.0:1784404955.012675:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729003904 00000100:00100000:3.0:1784404955.012762:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729004032 00000100:00100000:3.0:1784404955.012766:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729004032 00000100:00100000:3.0:1784404955.012784:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784404955.012794:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729003904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784404955.014039:0:18181:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1784404955.014121:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729003904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1325us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404955.014131:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784404955.014160:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784404955.014171:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729004032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784404955.014191:0:18181:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784404955.014227:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729004032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404955.014233:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784404955.014290:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729004032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404955.014410:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729003904:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0F:1784404955.464254:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0F:1784404955.843620:0:17906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0F:1784404956.036230:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729004160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784404956.036317:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404956.036392:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729004160 00000100:00100000:0.0:1784404956.036400:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729004160 00000100:00100000:0.0:1784404956.036459:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784404956.036468:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729004160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784404956.036496:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784404956.036541:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729004160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404956.036548:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784404956.036598:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729004160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404956.036725:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784404956.036736:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573263100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729004288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404956.036768:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404956.036803:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729004288 00000100:00100000:2.0:1784404956.036808:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729004288 00000100:00100000:2.0:1784404956.036870:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784404956.036878:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729004288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784404956.036890:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784404956.036927:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729004288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404956.036934:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784404956.036962:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573263100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729004288:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784404956.038949:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784404956.039138:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729004544:0@lo:400:kworker.0 00000100:00100000:1.0:1784404956.039207:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404956.039390:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729005056:0@lo:400:kworker.0 00000100:00100000:1.0:1784404956.039443:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404956.039473:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083729005568:0@lo:400:kworker.0 00000100:00100000:1.0:1784404956.039500:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404956.039528:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784404956.039534:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729004672:0@lo:400:kworker.0 00000100:00100000:1.0:1784404956.039558:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404956.039577:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083729005184:0@lo:400:kworker.0 00000100:00100000:1.0:1784404956.039600:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404956.039617:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083729005696:0@lo:400:kworker.0 00000100:00100000:1.0:1784404956.039636:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404956.039672:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729004544 00000100:00100000:1.0:1784404956.039681:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729004544 00000100:00100000:1.0:1784404956.039744:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784404956.039757:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729004544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404956.039833:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729004544:12345-0@lo:400:kworker.0 Request processed in 80us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404956.039841:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784404956.039902:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729005056 00000100:00100000:2.0:1784404956.039908:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729005056 00000100:00100000:1.0:1784404956.039923:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729005568 00000100:00100000:1.0:1784404956.039929:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729005568 00000100:00100000:2.0:1784404956.039953:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729004672 00000100:00100000:2.0:1784404956.039959:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729004672 00000100:00100000:1.0:1784404956.039963:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729005184 00000100:00100000:1.0:1784404956.039968:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729005184 00000100:00100000:1.0:1784404956.039991:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729005696 00000100:00100000:1.0:1784404956.039993:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729005696 00000100:00100000:2.0:1784404956.040005:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784404956.040015:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729005056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404956.040021:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784404956.040030:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083729005568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404956.040062:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729005056:12345-0@lo:400:kworker.0 Request processed in 49us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404956.040070:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784404956.040078:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083729005568:12345-0@lo:400:kworker.0 Request processed in 49us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404956.040087:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784404956.040087:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784404956.040106:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784404956.040112:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083729005184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404956.040139:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083729005184:12345-0@lo:400:kworker.0 Request processed in 28us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404956.040144:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784404956.040155:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784404956.040160:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083729005696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404956.040184:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083729005696:12345-0@lo:400:kworker.0 Request processed in 24us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404956.040189:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784404956.040219:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729004672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404956.040226:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3647:1871083729004416:0@lo:400:kworker.0 00000100:00100000:2.0:1784404956.040264:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729004672:12345-0@lo:400:kworker.0 Request processed in 167us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404956.040272:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404956.040276:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1784404956.040306:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784404956.040307:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729004928:0@lo:400:kworker.0 00000100:00080000:2.0:1784404956.040318:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784404956.040322:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784404956.040334:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404956.040367:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083729005440:0@lo:400:kworker.0 00000100:00100000:1.0:1784404956.040388:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404956.040403:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729004928 00000100:00100000:2.0:1784404956.040418:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729004928 00000100:00100000:1.0:1784404956.040420:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784404956.040430:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083729004800:0@lo:400:kworker.0 00000100:00100000:2.0:1784404956.040451:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784404956.040458:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404956.040462:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729004928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404956.040483:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083729005312:0@lo:400:kworker.0 00000100:00100000:2.0:1784404956.040502:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729004928:12345-0@lo:400:kworker.0 Request processed in 43us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404956.040509:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784404956.040521:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404956.040556:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729004928:0@lo:400:kworker.0 00000100:00100000:1.0:1784404956.040581:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729004416 00000100:00100000:1.0:1784404956.040584:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729004416 00000100:00100000:1.0:1784404956.040623:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1784404956.040631:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:3647:x1871083729004416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404956.040672:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:3647:x1871083729004416:12345-0@lo:400:kworker.0 Request processed in 42us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404956.040678:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1784404956.040707:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729005440 00000100:00100000:1.0:1784404956.040710:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729005440 00000100:00100000:1.0:1784404956.040748:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729004800 00000100:00100000:1.0:1784404956.040751:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729004800 00000100:00100000:1.0:1784404956.040761:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729005312 00000100:00100000:1.0:1784404956.040763:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729005312 00000100:00100000:1.0:1784404956.040774:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784404956.040779:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083729005440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404956.040807:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083729005440:12345-0@lo:400:kworker.0 Request processed in 28us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404956.040813:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784404956.040824:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784404956.040834:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083729004800:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784404956.040873:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784404956.040877:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784404956.040886:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083729004800:12345-0@lo:400:kworker.0 Request processed in 57us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404956.040893:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784404956.040903:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784404956.040909:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083729005312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404956.041188:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729004672:0@lo:400:kworker.0 00000100:00100000:0.0:1784404956.041199:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083729005184:0@lo:400:kworker.0 00010000:00080000:0.0:1784404956.041430:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd573334380 x1871083729005696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404956.041441:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083729005696:0@lo:400:kworker.0 00000100:00100000:0.0:1784404956.041481:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729004544:0@lo:400:kworker.0 00000100:00100000:0.0:1784404956.041833:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729005056:0@lo:400:kworker.0 00000100:00100000:0.0:1784404956.041936:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083729005568:0@lo:400:kworker.0 00000100:00100000:0.0:1784404956.042429:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083729004800:0@lo:400:kworker.0 00000100:00100000:0.0:1784404956.042441:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3647:1871083729004416:0@lo:400:kworker.0 00010000:00080000:0.0:1784404956.042453:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd573335f80 x1871083729005440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404956.042480:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083729005440:0@lo:400:kworker.0 00000001:00080000:0.0:1784404956.043267:0:17134:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:0.0:1784404956.043284:0:17134:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dd54133acc0 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:0.0:1784404956.043289:0:17134:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dd545b4a400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dd546c2cc00 00000020:00080000:0.0:1784404956.043293:0:17134:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9dd545b4a000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dd4427ce400 00000020:00080000:0.0:1784404956.043316:0:17193:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:0.0:1784404956.043396:0:17193:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1784404956.043460:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7a671 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404956.043473:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7a671 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404956.043481:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7a671 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404956.043488:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057e00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784404956.043494:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7a671 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404956.043502:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7a671 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404956.043522:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd574d22d00) 00010000:00010000:2.0:1784404956.043525:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784404956.043531:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7a671 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404956.043553:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7a671 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404956.047487:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083729005312:12345-0@lo:400:kworker.0 Request processed in 6566us (6956us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404956.047505:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784404956.047647:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083729005312:0@lo:400:kworker.0 00010000:00010000:1.0:1784404956.483878:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404957.507414:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404957.957925:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404957.958243:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707967232 00000100:00100000:1.0:1784404957.958254:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707967232 00000100:00100000:1.0:1784404957.958321:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 65 00000100:00100000:1.0:1784404957.958333:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+13:15592:x1871083707967232:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1784404957.958457:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+13:15592:x1871083707967232:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 Request processed in 127us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404957.958465:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 65 00000100:00080000:1.0:1784404957.969983:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784404957.973103:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404957.973145:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707967360 00000100:00100000:3.0:1784404957.973155:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707967360 00000100:00100000:3.0:1784404957.973212:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00100000:3.0:1784404957.973224:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44348df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+5:15592:x1871083707967360:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1784404957.973338:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44348df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+5:15592:x1871083707967360:12345-192.168.202.42@tcp:60:lhsmtool_posix.0 Request processed in 117us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404957.973346:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00080000:3.0:1784404957.973371:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784404957.985266:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404957.985303:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707967616 00000100:00100000:1.0:1784404957.985326:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707967616 00000100:00100000:1.0:1784404957.985381:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:1.0:1784404957.985402:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+13:15592:x1871083707967616:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784404957.985627:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+14:15592:x1871083707967616:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 237us (371us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1784404957.985634:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 12 00010000:00010000:2.0:1784404958.535211:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404958.947215:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404958.947259:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404958.947288:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404958.947326:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404958.947355:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404958.947374:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404958.947434:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404958.947466:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404958.947495:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404958.947526:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707967744 00000100:00100000:1.0:1784404958.947535:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707967744 00000100:00100000:1.0:1784404958.947588:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 168 00000100:00100000:1.0:1784404958.947598:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:2402:x1871083707967744:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404958.947666:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:2402:x1871083707967744:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 69us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404958.947674:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 168 00000100:00100000:3.0:1784404958.947955:0:19139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707968256 00000100:00100000:2.0:1784404958.947955:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707968640 00000100:00100000:3.0:1784404958.947960:0:19139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707968256 00000100:00100000:2.0:1784404958.947960:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707968640 00000100:00100000:2.0:1784404958.947994:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707968768 00000100:00100000:2.0:1784404958.947997:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707968768 00000100:00100000:1.0:1784404958.948093:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707968000 00000100:00100000:1.0:1784404958.948098:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707968000 00000100:00100000:1.0:1784404958.948118:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707968384 00000100:00100000:1.0:1784404958.948121:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707968384 00000100:00100000:0.0:1784404958.948183:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707968128 00000100:00100000:0.0:1784404958.948188:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707968128 00000100:00100000:3.0:1784404958.952945:0:19139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:3.0:1784404958.952965:0:19139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2400:x1871083707968640:12345-192.168.202.42@tcp:9:kworker.0 00000020:00000080:3.0:1784404958.953002:0:19139:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a3df 00000100:00080000:3.0:1784404958.953014:0:19139:0:(import.c:65:import_set_state_nolock()) ffff9dd4433fe800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784404958.953064:0:19139:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1784404958.953848:0:19139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c32ec117-73b3-46ba-ae0b-cf093b27aaed+2:2400:x1871083707968640:12345-192.168.202.42@tcp:9:kworker.0 Request processed in 889us (6585us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404958.953874:0:19139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:2.0:1784404958.953889:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:3.0:1784404958.953897:0:19139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:2.0:1784404958.953898:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2400:x1871083707968256:12345-192.168.202.42@tcp:9:kworker.0 00000100:00100000:3.0:1784404958.953903:0:19139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2400:x1871083707968768:12345-192.168.202.42@tcp:9:kworker.0 00000020:00000080:2.0:1784404958.953914:0:18661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a3a7 00000020:00000080:3.0:1784404958.953916:0:19139:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a3e6 00000100:00080000:2.0:1784404958.953927:0:18661:0:(import.c:65:import_set_state_nolock()) ffff9dd442081800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1784404958.957186:0:19139:0:(import.c:65:import_set_state_nolock()) ffff9dd4433ff800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784404958.957258:0:19139:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1784404958.957503:0:19139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c32ec117-73b3-46ba-ae0b-cf093b27aaed+2:2400:x1871083707968768:12345-192.168.202.42@tcp:9:kworker.0 Request processed in 3595us (10208us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404958.957513:0:19139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:3.0:1784404958.957560:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707967872 00000100:00100000:3.0:1784404958.957568:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707967872 00000100:00100000:3.0:1784404958.957597:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707968512 00000100:00100000:3.0:1784404958.957599:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707968512 00000100:00100000:3.0:1784404958.957641:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 71 00000100:00100000:3.0:1784404958.957648:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2402:x1871083707968000:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404958.957689:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2402:x1871083707968000:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 41us (10333us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404958.957806:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 71 00000100:00100000:3.0:1784404958.957821:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 72 00000100:00100000:3.0:1784404958.957828:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+14:2402:x1871083707967872:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404958.957878:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+14:2402:x1871083707967872:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 50us (10443us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404958.957883:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 72 00000100:00100000:3.0:1784404958.957896:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 73 00000100:00100000:3.0:1784404958.957902:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2402:x1871083707968512:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784404958.957924:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2402:x1871083707968512:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 23us (10429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404958.957930:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 73 00000100:00080000:3.0:1784404958.957952:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784404958.957956:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784404958.957959:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784404958.957961:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784404958.957970:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404958.957975:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404958.959253:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404958.959455:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 74 00000100:00100000:1.0:1784404958.959466:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:2402:x1871083707968384:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784404958.959519:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:2402:x1871083707968384:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 56us (12144us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404958.959526:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 74 00000100:00100000:0.0:1784404958.961341:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:0.0:1784404958.961356:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2402:x1871083707968128:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404958.961445:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2402:x1871083707968128:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 93us (13977us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404958.961453:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 33 00000001:00000004:2.0:1784404958.966630:0:18661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1784404958.966831:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+2:2400:x1871083707968256:12345-192.168.202.42@tcp:9:kworker.0 Request processed in 12927us (19617us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404958.966844:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:2.0:1784404959.108726:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784404959.108753:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729005824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404959.108824:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404959.109001:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729005824 00000100:00100000:3.0:1784404959.109009:0:19617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729005824 00000100:00100000:3.0:1784404959.109090:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784404959.109101:0:19617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729005824:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404959.109124:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784404959.109133:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729005952:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784404959.109149:0:19617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1784404959.109163:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404959.109190:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729005952 00000100:00100000:3.0:1784404959.109191:0:19617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729005824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404959.109194:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729005952 00000100:00100000:3.0:1784404959.109199:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784404959.109213:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784404959.109218:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083729005952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784404959.109237:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00080000:2.0:1784404959.109248:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784404959.109267:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083729005952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404959.109348:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729005824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784404959.109409:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729005952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784404959.116833:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1784404959.556963:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404960.131238:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729006080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404960.131330:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404960.131477:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729006080 00000100:00100000:3.0:1784404960.131485:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729006080 00000100:00100000:3.0:1784404960.131544:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784404960.131559:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729006080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784404960.131597:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784404960.131649:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729006080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404960.131656:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784404960.132291:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729006208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784404960.132349:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404960.132454:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729006208 00000100:00100000:3.0:1784404960.132459:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729006208 00000100:00100000:3.0:1784404960.132510:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784404960.132518:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729006208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784404960.132550:0:18181:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1784404960.132597:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729006208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404960.132606:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784404960.132698:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729006208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784404960.132888:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729006080:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1784404960.451271:0:17189:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784404960.451281:0:17189:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784404960.451323:0:17189:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1784404960.451332:0:17189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1784404960.579047:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404961.155347:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729006336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784404961.155526:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404961.155894:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729006336 00000100:00100000:0.0:1784404961.155904:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729006336 00000100:00100000:0.0:1784404961.155989:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784404961.156001:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083729006336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784404961.156034:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784404961.156095:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083729006336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404961.156102:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1784404961.156272:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784404961.156397:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729006336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784404961.156436:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404961.156443:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729006464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784404961.156474:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404961.157179:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3648:1871083729006592:0@lo:400:kworker.0 00000100:00100000:2.0:1784404961.157222:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404961.157262:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729007104:0@lo:400:kworker.0 00000100:00100000:2.0:1784404961.157288:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404961.157308:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083729007616:0@lo:400:kworker.0 00000100:00100000:2.0:1784404961.157333:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404961.157355:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784404961.157372:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729006720:0@lo:400:kworker.0 00000100:00100000:2.0:1784404961.157420:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404961.157445:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729007232:0@lo:400:kworker.0 00000100:00100000:2.0:1784404961.157469:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404961.157487:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083729007744:0@lo:400:kworker.0 00000100:00100000:2.0:1784404961.157509:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404961.157547:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729007104 00000100:00100000:2.0:1784404961.157553:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729007104 00000100:00100000:2.0:1784404961.157593:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729006720 00000100:00100000:2.0:1784404961.157596:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729006720 00000100:00100000:2.0:1784404961.157613:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784404961.157620:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729007104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404961.157678:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729007104:12345-0@lo:400:kworker.0 Request processed in 58us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404961.157685:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784404961.157829:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784404961.157836:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729006720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404961.157894:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729006720:12345-0@lo:400:kworker.0 Request processed in 58us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404961.157900:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784404961.157933:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729006720:0@lo:400:kworker.0 00000100:00100000:2.0:1784404961.157956:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729007104:0@lo:400:kworker.0 00000100:00100000:3.0:1784404961.158199:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729007616 00000100:00100000:3.0:1784404961.158205:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729007616 00000100:00100000:3.0:1784404961.158244:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729007744 00000100:00100000:3.0:1784404961.158248:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729007744 00000100:00100000:3.0:1784404961.158266:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784404961.158274:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083729007616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404961.158322:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083729007616:12345-0@lo:400:kworker.0 Request processed in 49us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404961.158329:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784404961.158344:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784404961.158350:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083729007744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404961.158389:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1871083729007744:12345-0@lo:400:kworker.0 Request processed in 40us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404961.158395:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1784404961.158464:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443cddc00 x1871083729007616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404961.158475:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083729007616:0@lo:400:kworker.0 00000100:00100000:2.0:1784404961.158491:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1871083729007744:0@lo:400:kworker.0 00000100:00080000:2.0:1784404961.158509:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784404961.158513:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784404961.158552:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083729006976:0@lo:400:kworker.0 00000100:00100000:2.0:1784404961.158578:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404961.158595:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083729007488:0@lo:400:kworker.0 00000100:00100000:2.0:1784404961.158615:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404961.158629:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784404961.158637:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729006848:0@lo:400:kworker.0 00000100:00100000:2.0:1784404961.158660:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404961.158680:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44348ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083729007360:0@lo:400:kworker.0 00000100:00100000:3.0:1784404961.158776:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729006976 00000100:00100000:3.0:1784404961.158780:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729006976 00000100:00100000:3.0:1784404961.158794:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729007488 00000100:00100000:3.0:1784404961.158797:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729007488 00000100:00100000:3.0:1784404961.158819:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784404961.158825:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083729006976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404961.158879:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083729006976:12345-0@lo:400:kworker.0 Request processed in 53us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404961.158885:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784404961.158896:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784404961.158902:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083729007488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404961.158927:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083729007488:12345-0@lo:400:kworker.0 Request processed in 26us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404961.158933:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784404961.158951:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729007232 00000100:00100000:3.0:1784404961.158954:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729007232 00000100:00100000:0.0:1784404961.159140:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729006464 00000100:00100000:0.0:1784404961.159144:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729006464 00000100:00100000:0.0:1784404961.159179:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784404961.159186:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729006464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784404961.159202:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784404961.159238:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729006464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (2763us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404961.159244:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1784404961.159283:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784404961.159294:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784404961.159297:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784404961.159373:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729006592 00000100:00100000:1.0:1784404961.159378:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729006592 00000100:00100000:1.0:1784404961.159421:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1784404961.159429:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:3648:x1871083729006592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404961.159469:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:3648:x1871083729006592:12345-0@lo:400:kworker.0 Request processed in 41us (2246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404961.159475:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1784404961.159520:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3648:1871083729006592:0@lo:400:kworker.0 00000100:00100000:1.0:1784404961.159578:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729006464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404961.160107:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404961.160146:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083729007872:0@lo:400:kworker.0 00000100:00100000:2.0:1784404961.160174:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404961.160200:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083729006976:0@lo:400:kworker.0 00000100:00100000:2.0:1784404961.160210:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083729007488:0@lo:400:kworker.0 00000100:00100000:3.0:1784404961.160295:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729006848 00000100:00100000:3.0:1784404961.160300:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729006848 00000100:00100000:1.0:1784404961.160374:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729007360 00000100:00100000:1.0:1784404961.160378:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729007360 00000100:00100000:1.0:1784404961.160402:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729007872 00000100:00100000:1.0:1784404961.160405:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729007872 00000100:00100000:1.0:1784404961.160426:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784404961.160432:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083729007360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404961.160473:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083729007360:12345-0@lo:400:kworker.0 Request processed in 41us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404961.160480:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784404961.160494:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784404961.160500:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083729007872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404961.160540:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083729007872:12345-0@lo:400:kworker.0 Request processed in 41us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404961.160546:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784404961.170249:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784404961.170276:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729007232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404961.170430:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729007232:12345-0@lo:400:kworker.0 Request processed in 168us (12959us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404961.170438:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784404961.170505:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784404961.170513:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729006848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404961.170545:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729006848:12345-0@lo:400:kworker.0 Request processed in 34us (11884us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404961.170551:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784404961.171055:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729007232:0@lo:400:kworker.0 00000100:00080000:3.0:1784404961.171303:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784404961.171324:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784404961.171359:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729006848:0@lo:400:kworker.0 00000100:00100000:3.0:1784404961.171384:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44348ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083729007360:0@lo:400:kworker.0 00010000:00080000:3.0:1784404961.171414:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443cdd500 x1871083729007872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404961.171425:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083729007872:0@lo:400:kworker.0 00010000:00010000:3.0:1784404961.603015:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784404962.185634:0:17134:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:3.0:1784404962.185651:0:17134:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:0.0:1784404962.185698:0:17193:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:0.0:1784404962.185712:0:17193:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:3.0:1784404962.628553:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784404962.694450:0:20532:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 16:02:41 (1784404961) 00010000:00010000:2.0:1784404963.655110:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404964.048695:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404964.048743:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404964.048784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404964.048807:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404964.048829:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404964.048883:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404964.048911:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707969152 00000100:00100000:3.0:1784404964.048921:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707969152 00000100:00100000:3.0:1784404964.048978:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707969408 00000100:00100000:3.0:1784404964.048982:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707969408 00000100:00100000:3.0:1784404964.048997:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707969024 00000100:00100000:3.0:1784404964.048999:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707969024 00000100:00100000:3.0:1784404964.049010:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707969536 00000100:00100000:3.0:1784404964.049012:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707969536 00000100:00100000:3.0:1784404964.049028:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 81 00000100:00100000:3.0:1784404964.049038:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2404:x1871083707969152:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404964.049216:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707968896 00000100:00100000:2.0:1784404964.049220:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707968896 00000100:00100000:2.0:1784404964.049276:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 170 00000100:00100000:2.0:1784404964.049283:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:2404:x1871083707968896:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404964.049321:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:2404:x1871083707968896:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 38us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404964.049328:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 170 00000100:00100000:2.0:1784404964.049373:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707969280 00000100:00100000:2.0:1784404964.049377:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707969280 00000100:00100000:2.0:1784404964.049404:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:2.0:1784404964.049410:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2404:x1871083707969280:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784404964.049438:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2404:x1871083707969280:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 28us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404964.049444:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:0.0:1784404964.049913:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 82 00000100:00100000:0.0:1784404964.049927:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:2404:x1871083707969408:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404964.049959:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:2404:x1871083707969408:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 38us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404964.049965:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 82 00000100:00100000:0.0:1784404964.049995:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 83 00000100:00100000:0.0:1784404964.050004:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+13:2404:x1871083707969024:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404964.050028:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a674842-02a6-4a6f-8c44-65f09b70250a+13:2404:x1871083707969024:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 26us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404964.050034:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 83 00000100:00100000:0.0:1784404964.050047:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 84 00000100:00100000:0.0:1784404964.050062:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2404:x1871083707969536:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784404964.050089:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2404:x1871083707969536:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 29us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404964.050095:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 84 00000100:00100000:3.0:1784404964.050399:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2404:x1871083707969152:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 1361us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404964.050414:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 81 00000100:00080000:3.0:1784404964.050442:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784404964.050448:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784404964.050450:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784404964.227016:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784404964.227067:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729008000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784404964.227144:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404964.227193:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729008000 00000100:00100000:1.0:1784404964.227202:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729008000 00000100:00080000:3.0:1784404964.227243:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784404964.227259:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784404964.227269:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729008000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784404964.227300:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1784404964.227365:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729008000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404964.227372:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784404964.227469:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729008000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784404964.227597:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784404964.227611:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729008128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404964.227646:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404964.227684:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729008128 00000100:00100000:3.0:1784404964.227689:0:19617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729008128 00000100:00100000:3.0:1784404964.227751:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784404964.227758:0:19617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729008128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784404964.227772:0:19617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1784404964.227806:0:19617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729008128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404964.227813:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1784404964.227825:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784404964.227890:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729008128:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784404964.675955:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784404965.059944:0:17906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784404965.251188:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729008256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784404965.251343:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404965.251447:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729008256 00000100:00100000:3.0:1784404965.251455:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729008256 00000100:00100000:3.0:1784404965.251502:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784404965.251512:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729008256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784404965.251551:0:17159:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784404965.251604:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729008256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404965.251611:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784404965.251685:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729008256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784404965.255789:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729008384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784404965.255894:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404965.255957:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729008384 00000100:00100000:1.0:1784404965.255965:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729008384 00000100:00100000:1.0:1784404965.256026:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784404965.256036:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729008384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784404965.256076:0:18181:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000001:00100000:3.0:1784404965.256742:0:18656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c32ec117-73b3-46ba-ae0b-cf093b27aaed 00000100:00100000:1.0:1784404965.257156:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729008384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1118us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404965.257186:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784404965.257259:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729008384:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1784404965.257651:0:18656:0:(genops.c:885:class_export_put()) final put ffff9dd4433fb000/c32ec117-73b3-46ba-ae0b-cf093b27aaed 00000020:00000080:1.0:1784404965.258661:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd4433fb000/c32ec117-73b3-46ba-ae0b-cf093b27aaed for lustre-OST0000 00000020:00000080:1.0:1784404965.258729:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd4433fe800 for lustre-OST0000 00000001:00100000:2.0:1784404965.263495:0:19474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0a674842-02a6-4a6f-8c44-65f09b70250a 00000020:00000080:2.0:1784404965.263510:0:19474:0:(genops.c:885:class_export_put()) final put ffff9dd442080800/0a674842-02a6-4a6f-8c44-65f09b70250a 00000001:00100000:2.0:1784404965.263557:0:19474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c32ec117-73b3-46ba-ae0b-cf093b27aaed 00000020:00000080:2.0:1784404965.263560:0:19474:0:(genops.c:885:class_export_put()) final put ffff9dd4433f9800/c32ec117-73b3-46ba-ae0b-cf093b27aaed 00000020:00000080:3.0:1784404965.264148:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd442080800/0a674842-02a6-4a6f-8c44-65f09b70250a for lustre-OST0001 00000020:00000080:3.0:1784404965.264216:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd4433f9800/c32ec117-73b3-46ba-ae0b-cf093b27aaed for lustre-OST0001 00000020:00000080:3.0:1784404965.264235:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd442081800 for lustre-OST0001 00000020:00000080:3.0:1784404965.264240:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd4433ff800 for lustre-OST0001 00010000:00010000:3.0:1784404965.699019:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404966.275206:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784404966.275238:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729008512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404966.275331:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404966.275466:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729008512 00000100:00100000:1.0:1784404966.275476:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729008512 00000100:00100000:1.0:1784404966.275559:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784404966.275570:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729008512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784404966.275602:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784404966.275651:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729008512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404966.275658:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1784404966.275875:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784404966.275918:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729008512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784404966.276263:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729009024:0@lo:400:kworker.0 00000100:00100000:3.0:1784404966.276304:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404966.276347:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083729009536:0@lo:400:kworker.0 00000100:00100000:3.0:1784404966.276375:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404966.276396:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083729010048:0@lo:400:kworker.0 00000100:00100000:3.0:1784404966.276416:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404966.276437:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784404966.276443:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729008896:0@lo:400:kworker.0 00000100:00100000:3.0:1784404966.276466:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404966.276484:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729009408:0@lo:400:kworker.0 00000100:00100000:3.0:1784404966.276507:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404966.276598:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083729009920:0@lo:400:kworker.0 00000100:00100000:3.0:1784404966.276623:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404966.276654:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729009536 00000100:00100000:3.0:1784404966.276660:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729009536 00000100:00100000:3.0:1784404966.276698:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729010048 00000100:00100000:3.0:1784404966.276701:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729010048 00000100:00100000:3.0:1784404966.276721:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729009920 00000100:00100000:3.0:1784404966.276732:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729009920 00000100:00100000:3.0:1784404966.276754:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784404966.276762:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083729009536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404966.276813:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083729009536:12345-0@lo:400:kworker.0 Request processed in 52us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404966.276821:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784404966.276836:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784404966.276843:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083729010048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404966.276898:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083729010048:12345-0@lo:400:kworker.0 Request processed in 56us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404966.276904:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784404966.276917:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784404966.276924:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083729009920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404966.276950:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083729009920:12345-0@lo:400:kworker.0 Request processed in 27us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404966.276956:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784404966.276979:0:19139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729009024 00000100:00100000:3.0:1784404966.276982:0:19139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729009024 00000100:00100000:3.0:1784404966.277010:0:19139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729008896 00000100:00100000:3.0:1784404966.277013:0:19139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729008896 00000100:00100000:3.0:1784404966.277031:0:19139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729009408 00000100:00100000:3.0:1784404966.277033:0:19139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729009408 00000100:00100000:3.0:1784404966.277047:0:19139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784404966.277053:0:19139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729009024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.277193:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3648:1871083729008640:0@lo:400:kworker.0 00000100:00100000:1.0:1784404966.277262:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784404966.277272:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729008896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784404966.277435:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784404966.277445:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729009408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.285797:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404966.285874:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083729009152:0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.285924:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404966.285949:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083729009664:0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.285972:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404966.286004:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729010176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404966.286030:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404966.286050:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784404966.286058:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729008768:0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.286097:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404966.286119:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729009280:0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.286143:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404966.286161:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083729009792:0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.286181:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404966.286221:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729008640 00000100:00100000:2.0:1784404966.286230:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729008640 00000100:00100000:2.0:1784404966.286278:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784404966.286288:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:3648:x1871083729008640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.286546:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:3648:x1871083729008640:12345-0@lo:400:kworker.0 Request processed in 258us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404966.286555:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784404966.286590:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729010176 00000100:00100000:2.0:1784404966.286594:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729010176 00000100:00100000:2.0:1784404966.286621:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784404966.286644:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1871083729010176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784404966.286661:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784404966.286694:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1871083729010176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404966.286701:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784404966.286726:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729008768 00000100:00100000:2.0:1784404966.286730:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729008768 00000100:00100000:2.0:1784404966.286762:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729009280 00000100:00100000:2.0:1784404966.286765:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729009280 00000100:00100000:2.0:1784404966.286780:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784404966.286786:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729008768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.286820:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729008768:12345-0@lo:400:kworker.0 Request processed in 34us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404966.286826:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784404966.286839:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784404966.286845:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729009280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.286896:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729009280:12345-0@lo:400:kworker.0 Request processed in 51us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404966.286902:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784404966.286920:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729009152 00000100:00100000:2.0:1784404966.286924:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729009152 00000100:00100000:2.0:1784404966.286949:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729009664 00000100:00100000:2.0:1784404966.286952:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729009664 00000100:00100000:2.0:1784404966.286969:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729009792 00000100:00100000:2.0:1784404966.286972:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729009792 00000100:00100000:2.0:1784404966.286987:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784404966.286993:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083729009152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.287025:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083729009152:12345-0@lo:400:kworker.0 Request processed in 32us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404966.287038:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784404966.287053:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784404966.287059:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083729009664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.287090:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083729009664:12345-0@lo:400:kworker.0 Request processed in 32us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404966.287097:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784404966.287108:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784404966.287114:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083729009792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.287138:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083729009792:12345-0@lo:400:kworker.0 Request processed in 25us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404966.287144:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784404966.287193:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729008768:0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.287204:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729009280:0@lo:400:kworker.0 00010000:00080000:2.0:1784404966.287215:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd5732bb480 x1871083729009792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404966.287225:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083729009792:0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.287241:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729010176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784404966.287251:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3648:1871083729008640:0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.287261:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083729009152:0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.287271:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083729009664:0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.287451:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083729009920:0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.287474:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729009024:0@lo:400:kworker.0 00000100:00100000:2.0:1784404966.287486:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083729009536:0@lo:400:kworker.0 00010000:00080000:2.0:1784404966.287499:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574d35f80 x1871083729010048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404966.287509:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083729010048:0@lo:400:kworker.0 00000100:00080000:2.0:1784404966.287557:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784404966.287561:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784404966.287564:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784404966.287567:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784404966.288528:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729008896:12345-0@lo:400:kworker.0 Request processed in 11244us (12046us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404966.288541:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784404966.289225:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729008896:0@lo:400:kworker.0 00000100:00100000:3.0:1784404966.289381:0:19139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729009024:12345-0@lo:400:kworker.0 Request processed in 12325us (13073us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404966.289390:0:19139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784404966.294984:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729009408:12345-0@lo:400:kworker.0 Request processed in 17532us (18466us total) trans 0 rc 0/0 00000100:00100000:0.0:1784404966.295013:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784404966.295223:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729009408:0@lo:400:kworker.0 00000100:00100000:3.0:1784404966.634453:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404966.634904:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707969792 00000100:00100000:2.0:1784404966.634914:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707969792 00000100:00100000:2.0:1784404966.634992:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:2.0:1784404966.635013:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+13:16354:x1871083707969792:12345-192.168.202.42@tcp:35:umount.0 00000001:00080000:2.0:1784404966.635245:0:17156:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1784404966.635339:0:17156:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:2.0:1784404966.635473:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a674842-02a6-4a6f-8c44-65f09b70250a+16:16354:x1871083707969792:12345-192.168.202.42@tcp:35:umount.0 Request processed in 471us (1030us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1784404966.635481:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 13 00000020:00080000:2.0:1784404966.635486:0:17156:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:0.0:1784404966.635599:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784404966.640263:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404966.640309:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784404966.640369:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404966.640468:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707969920 00000100:00100000:3.0:1784404966.640479:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707969920 00000100:00100000:3.0:1784404966.640546:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707970176 00000100:00100000:3.0:1784404966.640550:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707970176 00000100:00100000:3.0:1784404966.640564:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707970048 00000100:00100000:3.0:1784404966.640566:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707970048 00000100:00100000:3.0:1784404966.640583:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:3.0:1784404966.640593:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+15:2402:x1871083707969920:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404966.640611:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404966.640632:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd442056000/0x24b3e2e6dcd7a37d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7594 expref: 15 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404966.640650:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404966.640710:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+14:2402:x1871083707969920:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 118us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404966.640718:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:3.0:1784404966.640736:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:3.0:1784404966.640743:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+13:2402:x1871083707970176:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404966.640750:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404966.640759:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd540031e00/0x24b3e2e6dcd7a441 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed767b expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404966.640768:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404966.640786:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+12:2402:x1871083707970176:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 44us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404966.640792:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:3.0:1784404966.640803:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:3.0:1784404966.640824:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c990450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+11:2402:x1871083707970048:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784404966.640831:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404966.640839:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443548a00/0x24b3e2e6dcd7a384 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed75c5 expref: 11 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404966.640847:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404966.640911:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c990450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+10:2402:x1871083707970048:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 87us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404966.640918:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:3.0:1784404966.648175:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404966.648329:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707970304 00000100:00100000:2.0:1784404966.648343:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707970304 00000100:00100000:2.0:1784404966.648437:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 32 00000100:00100000:2.0:1784404966.648448:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2400:x1871083707970304:12345-192.168.202.42@tcp:9:umount.0 00000020:00000080:2.0:1784404966.648528:0:18661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a3a0 00000100:00080000:2.0:1784404966.648539:0:18661:0:(import.c:65:import_set_state_nolock()) ffff9dd4433fc800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784404966.648644:0:18661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1784404966.648812:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+2:2400:x1871083707970304:12345-192.168.202.42@tcp:9:umount.0 Request processed in 365us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404966.648819:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 32 00000100:00080000:0.0:1784404966.648982:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784404966.655321:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404966.673255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404966.674213:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707971200 00000100:00100000:2.0:1784404966.674224:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707971200 00000100:00100000:2.0:1784404966.674296:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00100000:2.0:1784404966.674307:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+16:2400:x1871083707971200:12345-192.168.202.42@tcp:39:umount.0 00000020:00000080:2.0:1784404966.674359:0:18438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a392 00000020:00010000:2.0:1784404966.674377:0:18438:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dd441a2e000: total 0 00000100:00080000:2.0:1784404966.674381:0:18438:0:(import.c:65:import_set_state_nolock()) ffff9dd441a2a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784404966.674413:0:18438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:2.0:1784404966.674584:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a674842-02a6-4a6f-8c44-65f09b70250a+15:2400:x1871083707971200:12345-192.168.202.42@tcp:39:umount.0 Request processed in 279us (1342us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1784404966.674594:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 67 00000020:00010000:1.0:1784404966.675905:0:19706:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dd441a2e000: total 0 00010000:00010000:1.0:1784404966.675962:0:19706:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dd441a2e000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1784404966.676008:0:19706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:1.0:1784404966.676012:0:19706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784404966.676023:0:19706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7a5ec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7700 expref: 14 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404966.676042:0:19706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:1.0:1784404966.676057:0:19706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784404966.676062:0:19706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c600/0x24b3e2e6dcd7a5bb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76eb expref: 13 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404966.676077:0:19706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd5706bc800) 00010000:00010000:1.0:1784404966.676080:0:19706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784404966.676084:0:19706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056e00/0x24b3e2e6dcd7a479 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7689 expref: 12 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404966.676101:0:19706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd574d22800) 00010000:00010000:1.0:1784404966.676103:0:19706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784404966.676107:0:19706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd540031000/0x24b3e2e6dcd7a4b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7697 expref: 11 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404966.676118:0:19706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dd574d22d00) 00010000:00010000:1.0:1784404966.676120:0:19706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784404966.676124:0:19706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331cc00/0x24b3e2e6dcd7a647 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7715 expref: 10 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404966.676141:0:19706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dd5706bcb00) 00010000:00010000:1.0:1784404966.676144:0:19706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784404966.676147:0:19706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7a45d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7682 expref: 9 pid: 17155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404966.676203:0:19706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dd44330f100) 00010000:00010000:1.0:1784404966.676206:0:19706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784404966.676210:0:19706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331da00/0x24b3e2e6dcd7a53d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed76c1 expref: 8 pid: 18438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404966.676250:0:19706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dd574d22700) 00010000:00010000:1.0:1784404966.676252:0:19706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784404966.676255:0:19706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7a69b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7731 expref: 7 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404966.676267:0:19706:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dd441a2e000, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1784404966.676281:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404966.676283:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404966.676284:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404966.683188:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404966.683510:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707971328 00000100:00100000:2.0:1784404966.683522:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707971328 00000100:00080000:0.0:1784404966.683584:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784404966.683600:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 68 00000100:00100000:2.0:1784404966.683611:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+5:2400:x1871083707971328:12345-192.168.202.42@tcp:39:umount.0 00000020:00000080:2.0:1784404966.683644:0:17154:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a399 00000100:00080000:2.0:1784404966.683660:0:17154:0:(import.c:65:import_set_state_nolock()) ffff9dd442081000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784404966.683698:0:17154:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1784404966.683711:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404966.683970:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a674842-02a6-4a6f-8c44-65f09b70250a+3:2400:x1871083707971328:12345-192.168.202.42@tcp:39:umount.0 Request processed in 360us (789us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1784404966.683986:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 68 00010000:00010000:3.0:1784404966.723945:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404967.747092:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784404968.489564:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404968.489620:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784404968.489657:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404968.489759:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707971584 00000100:00100000:1.0:1784404968.489771:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707971584 00000100:00100000:1.0:1784404968.489838:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707971456 00000100:00100000:1.0:1784404968.489843:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707971456 00000100:00100000:1.0:1784404968.489895:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707971712 00000100:00100000:1.0:1784404968.489899:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707971712 00000100:00100000:1.0:1784404968.489916:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:1.0:1784404968.489926:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+12:2402:x1871083707971584:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404968.489945:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404968.489967:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd442057600/0x24b3e2e6dcd7a3c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7635 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404968.489985:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404968.490053:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+11:2402:x1871083707971584:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 127us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404968.490062:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:1.0:1784404968.490082:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:1.0:1784404968.490107:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+10:2402:x1871083707971456:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404968.490116:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404968.490126:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443548400/0x24b3e2e6dcd7a3bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7604 expref: 10 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404968.490136:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404968.490156:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+9:2402:x1871083707971456:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 50us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404968.490163:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:1.0:1784404968.490176:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:1.0:1784404968.490183:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+8:2402:x1871083707971712:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784404968.490192:0:17141:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404968.490202:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd54516fc00/0x24b3e2e6dcd7a43a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7674 expref: 8 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404968.490212:0:17141:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404968.490231:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+7:2402:x1871083707971712:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 49us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404968.490237:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:0.0:1784404968.505806:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404968.506004:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707971968 00000100:00100000:2.0:1784404968.506015:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707971968 00000100:00100000:2.0:1784404968.506100:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:2.0:1784404968.506111:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c32ec117-73b3-46ba-ae0b-cf093b27aaed+6:2400:x1871083707971968:12345-192.168.202.42@tcp:39:umount.0 00000020:00000080:2.0:1784404968.506155:0:18438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a3d1 00000020:00010000:2.0:1784404968.506162:0:18438:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dd441a2c000: total 0 00000100:00080000:2.0:1784404968.506167:0:18438:0:(import.c:65:import_set_state_nolock()) ffff9dd441a28800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784404968.506197:0:18438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:2.0:1784404968.506374:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2400:x1871083707971968:12345-192.168.202.42@tcp:39:umount.0 Request processed in 264us (576us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1784404968.506382:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 69 00000020:00010000:1.0:1784404968.506790:0:19706:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dd441a2c000: total 0 00010000:00010000:1.0:1784404968.506797:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404968.506888:0:19706:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dd441a2c000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784404968.506932:0:19706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd574d22800) 00010000:00010000:1.0:1784404968.506936:0:19706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784404968.506945:0:19706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd54516f600/0x24b3e2e6dcd7a4c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed769e expref: 4 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404968.507007:0:19706:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dd441a2c000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1784404968.507021:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404968.507023:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404968.507025:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784404968.507513:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784404968.524121:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784404968.524237:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707972096 00000100:00100000:2.0:1784404968.524248:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707972096 00000100:00100000:2.0:1784404968.524344:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 70 00000100:00100000:2.0:1784404968.524366:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+5:2400:x1871083707972096:12345-192.168.202.42@tcp:39:umount.0 00000020:00000080:2.0:1784404968.524414:0:17155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a3d8 00000100:00080000:2.0:1784404968.524423:0:17155:0:(import.c:65:import_set_state_nolock()) ffff9dd573846000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784404968.524455:0:17155:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1784404968.524606:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c32ec117-73b3-46ba-ae0b-cf093b27aaed+3:2400:x1871083707972096:12345-192.168.202.42@tcp:39:umount.0 Request processed in 252us (496us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1784404968.524615:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 70 00010000:00010000:1.0:1784404968.524777:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784404968.525215:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784404968.587528:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784404968.587753:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707972352 00000100:00100000:1.0:1784404968.587764:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707972352 00000100:00100000:1.0:1784404968.587910:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 172 00000100:00100000:1.0:1784404968.587923:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+7:2400:x1871083707972352:12345-192.168.202.42@tcp:251:umount.0 00000020:00000080:1.0:1784404968.587984:0:17146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a36f 00000020:00010000:1.0:1784404968.587993:0:17146:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dd441a2f800: total 0 00000100:00080000:1.0:1784404968.587998:0:17146:0:(import.c:65:import_set_state_nolock()) ffff9dd441a2b000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784404968.588088:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242+3:2400:x1871083707972352:12345-192.168.202.42@tcp:251:umount.0 Request processed in 167us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404968.588098:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 172 00000020:00010000:3.0:1784404968.588178:0:17142:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dd441a2f800: total 0 00010000:00010000:3.0:1784404968.588246:0:17142:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dd441a2f800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784404968.588289:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd540031200/0x24b3e2e6dcd7a376 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed758d expref: 2 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404968.588323:0:17142:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dd441a2f800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1784404968.588334:0:17142:0:(genops.c:885:class_export_put()) final put ffff9dd441a2f800/18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242 00010000:00010000:3.0:1784404968.588359:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404968.588361:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404968.588363:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784404968.588376:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd441a2f800/18dca4e8-0fb1-425d-b8d8-4ce0cc1ab242 for MGS 00000020:00000080:3.0:1784404968.588421:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd441a2b000 for MGS 00010000:00010000:1.0:1784404968.774408:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404969.347219:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784404969.347243:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729010304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784404969.347346:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404969.347424:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729010304 00000100:00100000:2.0:1784404969.347434:0:19617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729010304 00000100:00100000:2.0:1784404969.347494:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784404969.347505:0:19617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729010304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784404969.347540:0:19617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1784404969.347601:0:19617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729010304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404969.347609:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1784404969.347632:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784404969.347673:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729010304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784404969.348026:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729010432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784404969.348078:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404969.348207:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729010432 00000100:00100000:1.0:1784404969.348213:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729010432 00000100:00100000:1.0:1784404969.348260:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784404969.348269:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729010432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784404969.348283:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1784404969.348343:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729010432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404969.348351:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1784404969.348646:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784404969.348675:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729010432:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784404969.803242:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784404970.246123:0:20727:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1784404970.258815:0:20727:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1784404970.258886:0:20727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7000/0x24b3e2e6dcd79f32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404970.258911:0:20727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7000/0x24b3e2e6dcd79f32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79f39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404970.258919:0:20727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7000/0x24b3e2e6dcd79f32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd79f39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404970.258927:0:20727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7000/0x24b3e2e6dcd79f32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd79f39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404970.258944:0:20727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784404970.258948:0:20727:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784404970.258976:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784404970.258981:0:20727:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784404970.258986:0:20727:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784404970.259022:0:20727:0:(import.c:65:import_set_state_nolock()) ffff9dd574d39000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1784404970.259101:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1871083729010560:0@lo:39:umount.0 00000100:00100000:3.0:1784404970.259182:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784404970.259297:0:19705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784404970.259310:0:19705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7000/0x24b3e2e6dcd79f32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd79f39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404970.259318:0:19705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7000 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404970.259321:0:19705:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7000/0x24b3e2e6dcd79f32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd79f39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404970.259330:0:19705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7000/0x24b3e2e6dcd79f32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd79f39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404970.259336:0:19705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7000/0x24b3e2e6dcd79f32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd79f39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404970.259341:0:19705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784404970.259343:0:19705:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784404970.259346:0:19705:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784404970.259372:0:19705:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7000/0x24b3e2e6dcd79f32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79f39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404970.259378:0:19705:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404970.259399:0:19705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7000/0x24b3e2e6dcd79f32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79f39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404970.259405:0:19705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7000/0x24b3e2e6dcd79f32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79f39 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404970.259416:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404970.259418:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404970.259419:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404970.259431:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3647:1871083729010688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784404970.259461:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404970.259520:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729010688 00000100:00100000:1.0:1784404970.259527:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729010688 00000100:00100000:1.0:1784404970.259574:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784404970.259582:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:3647:x1871083729010688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404970.259595:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404970.259609:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd4425c7a00/0x24b3e2e6dcd79f39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f32 expref: 24 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404970.259620:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404970.259656:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:3647:x1871083729010688:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404970.259663:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784404970.259704:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3647:1871083729010688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784404970.262215:0:18438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729010560 00000100:00100000:2.0:1784404970.262227:0:18438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729010560 00000100:00100000:2.0:1784404970.262314:0:18438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784404970.262325:0:18438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1871083729010560:12345-0@lo:39:umount.0 00000020:00000080:2.0:1784404970.262359:0:18438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79f63 00000100:00080000:2.0:1784404970.262372:0:18438:0:(import.c:65:import_set_state_nolock()) ffff9dd442284800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1784404970.267315:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404970.272638:0:18438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3645:x1871083729010560:12345-0@lo:39:umount.0 Request processed in 10302us (13444us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404970.272653:0:18438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:2.0:1784404970.272735:0:18438:0:(genops.c:885:class_export_put()) final put ffff9dd442283800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1784404970.273304:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd442283800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784404970.273368:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd442284800 for lustre-MDT0000 00000100:00080000:3.0:1784404970.275628:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd574d39000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784404970.275651:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1871083729010560:0@lo:39:umount.0 00000100:00080000:2.0:1784404970.275821:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784404970.275826:0:20727:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784404970.275831:0:20727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784404970.278886:0:20727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548758000/0x24b3e2e6dcd79e83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404970.278906:0:20727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548758000/0x24b3e2e6dcd79e83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79e8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404970.278915:0:20727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548758000/0x24b3e2e6dcd79e83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd79e8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404970.278923:0:20727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd548758000/0x24b3e2e6dcd79e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd79e8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404970.278944:0:20727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784404970.278960:0:20727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a29d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404970.278960:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784404970.278970:0:20727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a29d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404970.278976:0:20727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a29d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404970.278982:0:20727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a29d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404970.279006:0:20727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784404970.279013:0:20727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540031600/0x24b3e2e6dcd7a42c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a433 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404970.279020:0:20727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540031600/0x24b3e2e6dcd7a42c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a433 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404970.279062:0:19706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784404970.279068:0:19706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a29d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404970.279075:0:19706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1784404970.279078:0:19706:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a29d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404970.279085:0:19706:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd7a29d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784404970.279090:0:19706:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd7a29d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784404970.279094:0:19706:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1784404970.279096:0:19706:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1784404970.279097:0:19706:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1784404970.279130:0:19706:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a296 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd7a29d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404970.279134:0:19706:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784404970.279172:0:19706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a296 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd7a29d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404970.279179:0:19706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6600/0x24b3e2e6dcd7a296 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd7a29d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784404970.279191:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3648:1871083729010816:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784404970.279192:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404970.279193:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404970.279195:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404970.279258:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784404970.279274:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd548758000/0x24b3e2e6dcd79e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd79e8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784404970.279321:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729010816 00000100:00100000:3.0:1784404970.279329:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729010816 00000100:00100000:3.0:1784404970.279382:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784404970.279388:0:17140:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1784404970.279391:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:3648:x1871083729010816:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784404970.279395:0:17140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1784404970.279405:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784404970.279419:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd540030000/0x24b3e2e6dcd7a29d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a296 expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404970.279431:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784404970.279470:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:3648:x1871083729010816:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404970.279476:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784404970.279508:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3648:1871083729010816:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404970.279679:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758000 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404970.279683:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd548758000/0x24b3e2e6dcd79e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd79e8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404970.279691:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd548758000/0x24b3e2e6dcd79e83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd79e8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404970.279703:0:20727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd540031600/0x24b3e2e6dcd7a42c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a433 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404970.279704:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd548758000/0x24b3e2e6dcd79e83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd79e8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404970.279723:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784404970.279726:0:20727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd540031600/0x24b3e2e6dcd7a42c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a433 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404970.279726:0:17143:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1784404970.279747:0:20727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784404970.279752:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd548758000/0x24b3e2e6dcd79e83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79e8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404970.279757:0:20727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548759600/0x24b3e2e6dcd79e75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79e7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404970.279761:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784404970.279770:0:20727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548759600/0x24b3e2e6dcd79e75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79e7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404970.279780:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd548758000/0x24b3e2e6dcd79e83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79e8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404970.279789:0:20727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548759600/0x24b3e2e6dcd79e75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd79e7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404970.279792:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd548758000/0x24b3e2e6dcd79e83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79e8a expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404970.279805:0:20727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd548759600/0x24b3e2e6dcd79e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd79e7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404970.279819:0:20727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784404970.279822:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:2.0:1784404970.279825:0:20727:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1784404970.279827:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd540031600/0x24b3e2e6dcd7a42c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a433 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784404970.279830:0:20727:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1784404970.279836:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd540031600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404970.279839:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd540031600/0x24b3e2e6dcd7a42c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a433 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404970.279845:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd540031600/0x24b3e2e6dcd7a42c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd7a433 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784404970.279906:0:20727:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1784404970.279911:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1784404970.279916:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404970.279922:0:20727:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1784404970.279928:0:20727:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dd573225800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:1.0:1784404970.279933:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd540031600/0x24b3e2e6dcd7a42c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd7a433 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784404970.279937:0:20727:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dd573222000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:1.0:1784404970.279947:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000020:00080000:2.0:1784404970.279950:0:20727:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dd577f07800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:1.0:1784404970.279952:0:17143:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1784404970.279956:0:17143:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:2.0:1784404970.279961:0:20727:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9dd574d7e800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784404970.279970:0:20727:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9dd441a2c000 c32ec117-73b3-46ba-ae0b-cf093b27aaed 192.168.202.42@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1784404970.279975:0:20727:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9dd441a2e000 0a674842-02a6-4a6f-8c44-65f09b70250a 192.168.202.42@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:2.0:1784404970.279980:0:20727:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9dd56cb74d40) has exports, disconnecting them 00010000:00010000:1.0:1784404970.279985:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd540031600/0x24b3e2e6dcd7a42c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd7a433 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784404970.279986:0:20727:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dd573225800), last request at 1784404966 00010000:00010000:1.0:1784404970.279995:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:2.0:1784404970.279996:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a265 00000100:00080000:2.0:1784404970.280015:0:20727:0:(import.c:65:import_set_state_nolock()) ffff9dd573222800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784404970.280015:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd540031600/0x24b3e2e6dcd7a42c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd7a433 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404970.280029:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd540031600/0x24b3e2e6dcd7a42c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd7a433 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404970.280039:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784404970.280042:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd548759600/0x24b3e2e6dcd79e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd79e7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404970.280048:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404970.280051:0:17143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd548759600/0x24b3e2e6dcd79e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd79e7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404970.280057:0:17143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd548759600/0x24b3e2e6dcd79e75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd79e7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404970.280062:0:17143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd548759600/0x24b3e2e6dcd79e75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd79e7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404970.280067:0:17143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1784404970.280069:0:17143:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1784404970.280072:0:17143:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00080000:2.0:1784404970.280085:0:20727:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd573225800): rc 0 00010000:00010000:1.0:1784404970.280088:0:17143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd548759600/0x24b3e2e6dcd79e75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79e7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784404970.280089:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd573225800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1784404970.280095:0:17143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784404970.280105:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd548759600/0x24b3e2e6dcd79e75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79e7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784404970.280111:0:20727:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dd573222000), last request at 1784404966 00010000:00010000:1.0:1784404970.280115:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd548759600/0x24b3e2e6dcd79e75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79e7c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784404970.280122:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a100 00000100:00080000:2.0:1784404970.280131:0:20727:0:(import.c:65:import_set_state_nolock()) ffff9dd573227800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784404970.280140:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404970.280143:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1784404970.280145:0:20727:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd573222000): rc 0 00010000:00010000:1.0:1784404970.280147:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784404970.280149:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd573222000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1784404970.280155:0:20727:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dd577f07800), last request at 1784404893 00000020:00000080:2.0:1784404970.280158:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a051 00000100:00080000:2.0:1784404970.280162:0:20727:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7c000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784404970.280173:0:20727:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd577f07800): rc 0 00000100:00100000:1.0:1784404970.280173:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083729010944:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1784404970.280178:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd577f07800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1784404970.280183:0:20727:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dd574d7e800), last request at 1784404893 00000020:00000080:2.0:1784404970.280186:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79fef 00000100:00080000:2.0:1784404970.280191:0:20727:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784404970.280197:0:20727:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00100000:1.0:1784404970.280212:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404970.280250:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083729011072:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1784404970.280292:0:20727:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd574d7e800): rc 0 00000004:00000080:2.0:1784404970.280298:0:20727:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc2ae01c53ae0 00000100:00100000:1.0:1784404970.280299:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784404970.280321:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784404970.280322:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784404970.280325:0:20727:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:1.0:1784404970.280330:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083729011200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784404970.280352:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404970.280371:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729010944 00000100:00100000:1.0:1784404970.280376:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729010944 00000100:00100000:1.0:1784404970.280402:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729011072 00000100:00100000:1.0:1784404970.280405:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729011072 00000100:00100000:1.0:1784404970.280417:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729011200 00000100:00100000:1.0:1784404970.280419:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729011200 00000100:00100000:1.0:1784404970.280432:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784404970.280438:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+24:3649:x1871083729010944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404970.280458:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404970.280469:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd4425c6a00/0x24b3e2e6dcd79e8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd79e83 expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404970.280491:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404970.280521:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+23:3649:x1871083729010944:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404970.280528:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784404970.280550:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784404970.280556:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c991c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+22:3646:x1871083729011072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404970.280564:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404970.280574:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd540030600/0x24b3e2e6dcd7a433 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a42c expref: 22 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404970.280582:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404970.280609:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c991c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+21:3646:x1871083729011072:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404970.280615:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784404970.280656:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784404970.280661:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+20:3646:x1871083729011200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404970.280668:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784404970.280676:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd4425c6e00/0x24b3e2e6dcd79e7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd79e75 expref: 20 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404970.280685:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784404970.280705:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+19:3646:x1871083729011200:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404970.280711:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000020:00000080:1.0:1784404970.280735:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573225800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1784404970.280785:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573222000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1784404970.280806:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd577f07800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1784404970.280826:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd573222800 for lustre-MDT0000 00000020:00000080:1.0:1784404970.280831:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd573227800 for lustre-MDT0000 00000020:00000080:1.0:1784404970.280834:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd574d7c000 for lustre-MDT0000 00000100:00100000:1.0:1784404970.280885:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083729010944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784404970.280924:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083729011200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784404970.280932:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083729011072:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784404970.280946:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404970.280981:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404970.280987:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784404970.281142:0:20727:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1784404970.281159:0:20727:0:(import.c:65:import_set_state_nolock()) ffff9dd573aad000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1784404970.281641:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404970.281753:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729011328:0@lo:39:umount.0 00000100:00100000:1.0:1784404970.281798:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404970.281925:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729011328 00000100:00100000:2.0:1784404970.281932:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729011328 00000100:00100000:2.0:1784404970.281972:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784404970.281981:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1871083729011328:12345-0@lo:39:umount.0 00000020:00000080:2.0:1784404970.282004:0:17158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a07b 00000100:00080000:2.0:1784404970.282010:0:17158:0:(import.c:65:import_set_state_nolock()) ffff9dd4436a9800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1784404970.282029:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784404970.282033:0:20727:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1784404970.282045:0:20727:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1784404970.282103:0:20727:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1784404970.282117:0:20727:0:(import.c:65:import_set_state_nolock()) ffff9dd44319c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1784404970.282130:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784404970.282132:0:20727:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000001:00000004:2.0:1784404970.282138:0:17158:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000004:00080000:0.0:1784404970.282141:0:20727:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1784404970.282215:0:20727:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1784404970.282226:0:20727:0:(import.c:65:import_set_state_nolock()) ffff9dd441a60000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784404970.282246:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3645:x1871083729011328:12345-0@lo:39:umount.0 Request processed in 265us (446us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1784404970.282263:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000020:00080000:0.0:1784404970.282269:0:20727:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9dd56cb74d40) has no exports 00010000:00010000:1.0:1784404970.283825:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404970.283888:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729011456:0@lo:9:umount.0 00000100:00100000:1.0:1784404970.283956:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404970.283994:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729011584:0@lo:9:umount.0 00000100:00100000:1.0:1784404970.284016:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784404970.284059:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd573aad000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784404970.284066:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574ea5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729011328:0@lo:39:umount.0 00000100:00100000:2.0:1784404970.284144:0:19139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729011456 00000100:00100000:2.0:1784404970.284151:0:19139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729011456 00000100:00100000:2.0:1784404970.284191:0:19139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729011584 00000100:00100000:2.0:1784404970.284194:0:19139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729011584 00000100:00100000:3.0:1784404970.284217:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784404970.284248:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1871083729011456:12345-0@lo:9:umount.0 00000100:00100000:2.0:1784404970.284253:0:19139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784404970.284262:0:19139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1871083729011584:12345-0@lo:9:umount.0 00000020:00000080:3.0:1784404970.284276:0:18660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a146 00000020:00000080:2.0:1784404970.284277:0:19139:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a2a4 00000100:00080000:3.0:1784404970.284295:0:18660:0:(import.c:65:import_set_state_nolock()) ffff9dd5441d0000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1784404970.284297:0:19139:0:(import.c:65:import_set_state_nolock()) ffff9dd442086800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784404970.284331:0:18660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000001:00000004:2.0:1784404970.286431:0:19139:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1784404970.286646:0:19139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3645:x1871083729011584:12345-0@lo:9:umount.0 Request processed in 2381us (2624us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404970.286657:0:19139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1784404970.286696:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784404970.287923:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784404970.287946:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784404970.287997:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd44319c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784404970.288020:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784404970.288023:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784404970.288028:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729011456:0@lo:9:umount.0 00000100:00080000:1.0:1784404970.288044:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd441a60000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784404970.288058:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784404970.288059:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784404970.288062:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729011584:0@lo:9:umount.0 00000100:00100000:3.0:1784404970.288158:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3645:x1871083729011456:12345-0@lo:9:umount.0 Request processed in 196us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404970.288169:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000020:00080000:0.0:1784404970.296627:0:20727:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9dd56cb74d40) has no exports 00000020:00000080:0.0:1784404970.336332:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79ed0 00000020:00000080:0.0:1784404970.336348:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd44254a800/lustre-QMT0000_UUID 00000020:01000000:0.0:1784404970.336368:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1784404970.336399:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd44254a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1784404970.336461:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784404970.336471:0:20727:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784404970.336475:0:20727:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9dd56cb73380) has no exports 00000020:00000080:3.0:1784404970.346239:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79ec9 00000020:00000080:3.0:1784404970.346255:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd57c5d5000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784404970.346373:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd57c5d5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784404970.346621:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784404970.346633:0:20727:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784404970.346638:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd57c5d1800/lustre-QMT0000_UUID 00000020:00000080:3.0:1784404970.346640:0:20727:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd57c5d1800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1784404970.346652:0:20727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:2.0:1784404970.371219:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784404970.371245:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729011712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784404970.371339:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404970.371489:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729011712 00000100:00100000:1.0:1784404970.371508:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729011712 00000100:00100000:1.0:1784404970.371587:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784404970.371596:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1871083729011712:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1784404970.371603:0:18181:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784404970.371678:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1871083729011712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (328us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784404970.371685:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:02020000:0.0:1784404970.371732:0:3649:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1784404970.379794:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784404970.379803:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9dd577f59800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784404970.379807:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784404970.393240:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9dd577f59800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784404970.393255:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 511 00000100:00080000:0.0:1784404970.393266:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dd577f59800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784404970.393325:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd570592300 x1871083729011840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784404970.393481:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729011840:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1784404970.393560:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404970.393664:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729011840 00000100:00100000:3.0:1784404970.393673:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729011840 00000100:00100000:3.0:1784404970.393718:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784404970.393727:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1871083729011840:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1784404970.393744:0:17159:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784404970.399171:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1871083729011840:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 5435us (5602us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784404970.399185:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1784404970.399308:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd577f59800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784404970.399315:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784404970.399319:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729011840:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:0.0:1784404970.820410:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784404971.395024:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784404971.395031:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784404971.395035:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd577f59800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784404971.395044:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 588 00000100:00080000:1.0:1784404971.395051:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784404971.395059:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dd577f59800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404971.395083:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd574d37b80 x1871083729012096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784404971.395180:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729012224:0@lo:400:kworker.0 00000100:00100000:1.0:1784404971.395256:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404971.395337:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083729012736:0@lo:400:kworker.0 00000100:00100000:1.0:1784404971.395365:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404971.395392:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784404971.395398:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729012352:0@lo:400:kworker.0 00000100:00100000:1.0:1784404971.395446:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404971.395463:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083729012864:0@lo:400:kworker.0 00000100:00100000:1.0:1784404971.395484:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404971.395656:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083729011968:0@lo:400:kworker.0 00000100:00100000:0.0:1784404971.395713:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404971.395754:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083729012608:0@lo:400:kworker.0 00000100:00100000:0.0:1784404971.395782:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404971.395802:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784404971.395808:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083729012480:0@lo:400:kworker.0 00000100:00100000:0.0:1784404971.395831:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404971.395847:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083729012992:0@lo:400:kworker.0 00000100:00100000:0.0:1784404971.395897:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404971.396030:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729011968 00000100:00100000:1.0:1784404971.396041:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729011968 00000100:00100000:1.0:1784404971.396100:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1784404971.396109:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+19:3649:x1871083729011968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404971.396163:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fccb8c6c-dea6-48fe-a863-d61ae2c1427e+19:3649:x1871083729011968:12345-0@lo:400:kworker.0 Request processed in 55us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404971.396171:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1784404971.396439:0:19703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729012224 00000100:00100000:3.0:1784404971.396444:0:19703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729012224 00000100:00100000:3.0:1784404971.396491:0:19703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729012352 00000100:00100000:3.0:1784404971.396494:0:19703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729012352 00000100:00100000:3.0:1784404971.396516:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784404971.396524:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729012224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404971.396571:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729012224:12345-0@lo:400:kworker.0 Request processed in 49us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404971.396578:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784404971.396591:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784404971.396597:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729012352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404971.396637:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729012352:12345-0@lo:400:kworker.0 Request processed in 28us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404971.396644:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784404971.396676:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729012736 00000100:00100000:3.0:1784404971.396679:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729012736 00000100:00080000:1.0:1784404971.396784:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784404971.396789:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784404971.396791:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784404971.396817:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729012864 00000100:00100000:1.0:1784404971.396822:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729012864 00000100:00100000:1.0:1784404971.396838:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729012608 00000100:00100000:1.0:1784404971.396840:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729012608 00000100:00100000:1.0:1784404971.396848:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729012480 00000100:00100000:1.0:1784404971.396873:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729012480 00000100:00100000:1.0:1784404971.396884:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729012992 00000100:00100000:1.0:1784404971.396886:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729012992 00000100:00100000:1.0:1784404971.396908:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784404971.396914:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083729012992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784404971.396949:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083729012992:12345-0@lo:400:kworker.0 Request processed in 34us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1784404971.396955:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784404971.396968:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784404971.396972:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1871083729012864:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784404971.396987:0:17153:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784404971.397016:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1871083729012864:12345-0@lo:400:kworker.0 Request processed in 42us (1530us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784404971.397021:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784404971.397033:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784404971.397038:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1871083729012608:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784404971.397042:0:17153:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784404971.397065:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1871083729012608:12345-0@lo:400:kworker.0 Request processed in 26us (1282us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784404971.397071:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784404971.397083:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784404971.397087:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1871083729012480:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784404971.397091:0:17153:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784404971.397113:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1871083729012480:12345-0@lo:400:kworker.0 Request processed in 25us (1281us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784404971.397118:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1784404971.397132:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784404971.397145:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729012096:0@lo:38:kworker.0 00000100:00100000:1.0:1784404971.397175:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404971.397200:0:18181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729012096 00000100:00100000:1.0:1784404971.397203:0:18181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729012096 00000100:00100000:1.0:1784404971.397222:0:18181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784404971.397226:0:18181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1871083729012096:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1784404971.397244:0:18181:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1784404971.397286:0:18181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1871083729012096:12345-0@lo:38:kworker.0 Request processed in 58us (110us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784404971.397293:0:18181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1784404971.397355:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd577f59800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784404971.397361:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784404971.397365:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729012096:0@lo:38:kworker.0 00000100:00100000:1.0:1784404971.397427:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729012352:0@lo:400:kworker.0 00000100:00080000:1.0:1784404971.397439:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784404971.397442:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9dd4433f8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784404971.397445:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784404971.397451:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9dd4433f8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784404971.397455:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 543 00000100:00080000:1.0:1784404971.397461:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dd4433f8000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784404971.397486:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd577ff9c00 x1871083729013120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784404971.397506:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083729012864:0@lo:400:kworker.0 00000100:00100000:1.0:1784404971.397519:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729012224:0@lo:400:kworker.0 00000100:00100000:1.0:1784404971.397539:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083729013120:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1784404971.397565:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404971.397584:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729013120 00000100:00100000:1.0:1784404971.397588:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729013120 00000100:00100000:1.0:1784404971.397601:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784404971.397606:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1871083729013120:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1784404971.397614:0:17153:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1784404971.397641:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1871083729013120:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 34us (75us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784404971.397646:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1784404971.397679:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd4433f8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784404971.397684:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784404971.397687:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083729013120:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1784404971.398048:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784404971.398059:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083729012736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784404971.398110:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083729012736:12345-0@lo:400:kworker.0 Request processed in 55us (2743us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404971.398118:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1784404971.398219:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784404971.398223:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9dd4436ab000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784404971.398227:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784404971.398230:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9dd4436ab000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784404971.398233:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 511 00000100:00080000:0.0:1784404971.398238:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dd4436ab000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784404971.398255:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd570591c00 x1871083729013248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784404971.398290:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083729012480:0@lo:400:kworker.0 00010000:00080000:0.0:1784404971.398308:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574d37480 x1871083729012992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404971.398332:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083729012992:0@lo:400:kworker.0 00000100:00100000:0.0:1784404971.398344:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083729011968:0@lo:400:kworker.0 00000100:00080000:0.0:1784404971.398352:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784404971.398364:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9dd442662000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784404971.398367:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784404971.398370:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9dd442662000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784404971.398373:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 526 00000100:00080000:0.0:1784404971.398377:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dd442662000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784404971.398391:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd570590e00 x1871083729013376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784404971.398401:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083729012608:0@lo:400:kworker.0 00000100:00100000:3.0:1784404971.398545:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1871083729013248:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1784404971.398578:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404971.398606:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1871083729013376:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1784404971.398688:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404971.398832:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729013248 00000100:00100000:1.0:1784404971.398837:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729013248 00000100:00100000:1.0:1784404971.398886:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729013376 00000100:00100000:1.0:1784404971.398890:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729013376 00000100:00100000:1.0:1784404971.398902:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784404971.398906:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1871083729013248:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1784404971.398917:0:17153:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1784404971.398949:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1871083729013248:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 41us (371us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784404971.398955:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784404971.398968:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784404971.398973:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1871083729013376:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1784404971.398980:0:17153:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1784404971.399001:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1871083729013376:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 28us (375us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784404971.399007:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1784404971.399034:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd574d35500 x1871083729012736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404971.399045:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083729012736:0@lo:400:kworker.0 00000100:00080000:3.0:1784404971.399170:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd4436ab000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784404971.399175:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784404971.399178:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1871083729013248:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1784404971.399186:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd442662000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784404971.399189:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784404971.399191:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1871083729013376:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1784404971.401791:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784404971.401814:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729013504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784404971.401903:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784404971.402013:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729013504 00000100:00100000:3.0:1784404971.402021:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729013504 00000100:00100000:3.0:1784404971.402077:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784404971.402087:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729013504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784404971.402115:0:18664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784404971.402171:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729013504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784404971.402179:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784404971.402344:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729013504:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1784404971.844011:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784404971.914421:0:18656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784404971.914535:0:18656:0:(genops.c:885:class_export_put()) final put ffff9dd5441d5000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1784404971.915529:0:18656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0a674842-02a6-4a6f-8c44-65f09b70250a 00000020:00000080:0.0:1784404971.915535:0:18656:0:(genops.c:885:class_export_put()) final put ffff9dd54851e000/0a674842-02a6-4a6f-8c44-65f09b70250a 00000001:00100000:1.0:1784404971.917674:0:17134:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784404971.917685:0:17134:0:(genops.c:885:class_export_put()) final put ffff9dd574d7e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784404971.926975:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd5441d5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1784404971.927070:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd5441d0000 for lustre-OST0000 00000001:00100000:1.0:1784404971.929228:0:17134:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c32ec117-73b3-46ba-ae0b-cf093b27aaed 00000001:00080000:1.0:1784404971.929241:0:17134:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:1.0:1784404971.929264:0:17134:0:(genops.c:885:class_export_put()) final put ffff9dd441a2c000/c32ec117-73b3-46ba-ae0b-cf093b27aaed 00000001:00100000:1.0:1784404971.929283:0:17134:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0a674842-02a6-4a6f-8c44-65f09b70250a 00000001:00080000:1.0:1784404971.929288:0:17134:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:1.0:1784404971.929293:0:17134:0:(genops.c:885:class_export_put()) final put ffff9dd441a2e000/0a674842-02a6-4a6f-8c44-65f09b70250a 00000020:00000080:2.0:1784404971.932492:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd54851e000/0a674842-02a6-4a6f-8c44-65f09b70250a for lustre-OST0000 00000020:00000080:2.0:1784404971.938350:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd574d7e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1784404971.938848:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd441a2c000/c32ec117-73b3-46ba-ae0b-cf093b27aaed for lustre-MDT0000 00000020:00000080:3.0:1784404971.939540:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd441a2e000/0a674842-02a6-4a6f-8c44-65f09b70250a for lustre-MDT0000 00000020:00000080:3.0:1784404971.939564:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd4433fc800 for lustre-OST0000 00000020:00000080:3.0:1784404971.939569:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd574d7b000 for lustre-MDT0000 00000020:00000080:3.0:1784404971.939572:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd441a28800 for lustre-MDT0000 00000020:00000080:3.0:1784404971.939575:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd441a2a000 for lustre-MDT0000 00000001:00100000:0.0:1784404971.940137:0:17886:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1784404971.940149:0:17886:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1784404971.940154:0:17886:0:(genops.c:885:class_export_put()) final put ffff9dd543072800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1784404971.940174:0:17886:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c32ec117-73b3-46ba-ae0b-cf093b27aaed 00000001:00080000:0.0:1784404971.940178:0:17886:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1784404971.940181:0:17886:0:(genops.c:885:class_export_put()) final put ffff9dd441a2c800/c32ec117-73b3-46ba-ae0b-cf093b27aaed 00000001:00100000:0.0:1784404971.940186:0:17886:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0a674842-02a6-4a6f-8c44-65f09b70250a 00000001:00080000:0.0:1784404971.940189:0:17886:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1784404971.940191:0:17886:0:(genops.c:885:class_export_put()) final put ffff9dd442084000/0a674842-02a6-4a6f-8c44-65f09b70250a 00000020:00000080:2.0:1784404971.942154:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd543072800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1784404971.942241:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd441a2c800/c32ec117-73b3-46ba-ae0b-cf093b27aaed for lustre-MDT0001 00000020:00000080:2.0:1784404971.942280:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd442084000/0a674842-02a6-4a6f-8c44-65f09b70250a for lustre-MDT0001 00000020:00000080:2.0:1784404971.942305:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd4436a9800 for lustre-MDT0001 00000020:00000080:2.0:1784404971.942310:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd573846000 for lustre-MDT0001 00000020:00000080:2.0:1784404971.942314:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd442081000 for lustre-MDT0001 00000020:01000000:3.0:1784404972.355362:0:20727:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd5589fe660 - data ffff9dd56629de58/ffff9dd443280800 00000020:01000000:3.0:1784404972.355521:0:20727:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd5624f1ea0 - data ffff9dd441d0e6c0/ffff9dd575883000 00000001:00000004:3.0:1784404972.364038:0:20727:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:0.0:1784404972.423887:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784404972.423897:0:20727:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784404972.423915:0:20727:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9dd574ea5c00 x1871083729011328/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784404980 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404972.423962:0:20727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1784404972.429252:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784404972.429259:0:20727:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1784404972.429439:0:20727:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784404972.429442:0:20727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784404972.430138:0:17177:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784404972.430143:0:17177:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:2.0:1784404972.430155:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1784404972.431032:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784404972.431037:0:20727:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1784404972.431056:0:20727:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784404972.431246:0:20727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784404972.436250:0:17179:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784404972.436257:0:17179:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:2.0:1784404972.436281:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1784404972.443741:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79e98 00000020:00000080:0.0:1784404972.443752:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd573aa8800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784404972.444655:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573aa8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784404972.446285:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79ead 00000020:00000080:0.0:1784404972.446591:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd573aab800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784404972.446640:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1784404972.446649:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784404972.446668:0:20727:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784404972.446673:0:20727:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9dd573b18000) has no exports 00000004:01000000:0.0:1784404972.446907:0:20727:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1784404972.446915:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79f0f 00000020:00000080:0.0:1784404972.446920:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd573a3b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784404972.447405:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573aab800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1784404972.447487:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784404972.447494:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784404972.447501:0:20727:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784404972.447505:0:20727:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9dd5704619c0) has no exports 00000020:00000080:0.0:1784404972.447514:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79f08 00000020:00000080:0.0:1784404972.447519:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd44254c000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784404972.447544:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573a3b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1784404972.448116:0:20727:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784404972.448121:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784404972.448126:0:20727:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1784404972.448131:0:20727:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784404972.448134:0:20727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784404972.448193:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd44254c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784404972.448287:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784404972.448296:0:20727:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784404972.448304:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79efa 00000020:00000080:0.0:1784404972.448310:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd44333f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784404972.448336:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd441a60000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784404972.448342:0:37:0:(genops.c:885:class_export_put()) final put ffff9dd44333c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784404972.448345:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd44333c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1784404972.448351:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784404972.448541:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784404972.448546:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784404972.448551:0:20727:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784404972.448555:0:20727:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9dd57d723380) has no exports 00000020:00000080:0.0:1784404972.448559:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79ef3 00000020:00000080:0.0:1784404972.448564:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd443199000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784404972.448581:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd44333f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1784404972.449216:0:20727:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784404972.449221:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784404972.449224:0:20727:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1784404972.449229:0:20727:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784404972.449231:0:20727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784404972.450551:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443199000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784404972.450710:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784404972.450721:0:20727:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1784404972.450739:0:20727:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1784404972.450746:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79ee5 00000020:00000080:0.0:1784404972.450753:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd44254a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784404972.450941:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd44319c800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784404972.450949:0:37:0:(genops.c:885:class_export_put()) final put ffff9dd44254b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784404972.450951:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd44254b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1784404972.450956:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784404972.451134:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1784404972.451140:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784404972.451146:0:20727:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784404972.451150:0:20727:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9dd56cb70000) has no exports 00000020:00000080:0.0:1784404972.451156:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79ede 00000020:00000080:0.0:1784404972.451161:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd44254f000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784404972.451188:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd44254a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00010000:01000000:2.0:1784404972.454943:0:20727:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1784404972.454954:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784404972.454960:0:20727:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784404972.454969:0:20727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784404972.457244:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd44254f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784404972.465466:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784404972.465487:0:20727:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784404972.465526:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784404972.465532:0:20727:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784404972.465539:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd577f5a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784404972.465544:0:20727:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd577f5a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1784404972.465556:0:20727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784404972.466252:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79eb4 00000020:00000080:2.0:1784404972.466271:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd573aaf800/lustre-MDD0000_UUID 00000020:00000080:1.0:1784404972.468177:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd573aad000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1784404972.468193:0:37:0:(genops.c:885:class_export_put()) final put ffff9dd44254d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784404972.468197:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd44254d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1784404972.468214:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784404972.468483:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573aaf800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1784404972.468531:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1784404972.468538:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404972.468562:0:20727:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784404972.468568:0:20727:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9dd56cb719c0) has no exports 00000020:00000080:2.0:1784404972.468606:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784404972.468613:0:20727:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1784404972.468616:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd573aaf000/lustre-MDD0000_UUID 00000020:00000080:2.0:1784404972.468619:0:20727:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573aaf000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1784404972.468624:0:20727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1784404972.468685:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79ebb 00000020:00000080:2.0:1784404972.468693:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd573aa9000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784404972.468715:0:20727:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd443e83000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1784404972.468719:0:20727:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd443e83000 3 00000020:01000004:2.0:1784404972.468722:0:20727:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd443e83000 from lustre-MDT0000 00000020:00000080:2.0:1784404972.468744:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784404972.468749:0:20727:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1784404972.468751:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd573aaa000/lustre-MDT0000_UUID 00000020:00000080:2.0:1784404972.468754:0:20727:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573aaa000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1784404972.469422:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573aa9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1784404972.470309:0:20727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1784404972.470398:0:20727:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1784404972.470405:0:20727:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1784404972.470410:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1784404972.470415:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404972.470420:0:20727:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784404972.470429:0:20727:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9dd549484800 fccb8c6c-dea6-48fe-a863-d61ae2c1427e 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784404972.470436:0:20727:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9dd570463380) has exports, disconnecting them 00000020:00080000:2.0:1784404972.470446:0:20727:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9dd549484800), last request at 1784404877 00000020:00000080:2.0:1784404972.470670:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79e60 00000020:00010000:2.0:1784404972.470678:0:20727:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9dd549484800: total 0 00000100:00080000:2.0:1784404972.470684:0:20727:0:(import.c:65:import_set_state_nolock()) ffff9dd549487800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784404972.470698:0:20727:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd549484800): rc 0 00000020:00080000:2.0:1784404972.470704:0:20727:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9dd570463380) has no exports 00000020:00010000:1.0:1784404972.471210:0:17142:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9dd549484800: total 0 00010000:00010000:1.0:1784404972.471275:0:17142:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9dd549484800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1784404972.471310:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd540031400/0x24b3e2e6dcd7a417 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a410 expref: 14 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404972.471332:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd54516f000/0x24b3e2e6dcd7a03c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a035 expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404972.471345:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151ae00/0x24b3e2e6dcd79f8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f86 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404972.471361:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151b000/0x24b3e2e6dcd79e6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd79e67 expref: 11 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404972.471374:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443548c00/0x24b3e2e6dcd7a409 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a402 expref: 10 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404972.471386:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd548758200/0x24b3e2e6dcd79f7f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f78 expref: 9 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404972.471409:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151aa00/0x24b3e2e6dcd7a0eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a0e4 expref: 8 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404972.471419:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151a200/0x24b3e2e6dcd7a226 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a21f expref: 7 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404972.471463:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443549800/0x24b3e2e6dcd7a425 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a41e expref: 6 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404972.471475:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151b800/0x24b3e2e6dcd79f9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd79f94 expref: 5 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404972.471508:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151a800/0x24b3e2e6dcd7a250 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a249 expref: 4 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404972.471519:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd540031a00/0x24b3e2e6dcd7a28f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a288 expref: 3 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404972.471530:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd58151b600/0x24b3e2e6dcd7a0c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a0ba expref: 2 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404972.471541:0:17142:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9dd549484800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1784404972.471556:0:17142:0:(genops.c:885:class_export_put()) final put ffff9dd549484800/fccb8c6c-dea6-48fe-a863-d61ae2c1427e 00010000:00010000:1.0:1784404972.471567:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404972.471570:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404972.471571:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404972.471617:0:17146:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9dd5510cd600:17146] 0 exiting: rc = 1 00000100:00100000:0.0:1784404972.471725:0:17149:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9dd545294400:17149] 2 exiting: rc = 0 00000100:00100000:1.0:1784404972.471815:0:17147:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9dd443614800:17147] 1 exiting: rc = 0 00000020:00000080:2.0:1784404972.472993:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd549484800/fccb8c6c-dea6-48fe-a863-d61ae2c1427e for MGS 00000020:00000080:2.0:1784404972.473038:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd549487800 for MGS 00000100:00100000:2.0:1784404972.473095:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473106:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473115:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473124:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473134:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473145:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473155:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473160:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473165:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473171:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473177:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473182:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473187:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473193:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473198:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473203:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473209:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473213:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473218:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473224:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473229:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473249:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473289:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473295:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473301:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473310:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473316:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473322:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473328:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473333:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473345:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473350:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473356:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473361:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473367:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473382:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473388:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473393:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473399:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473404:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473409:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473415:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473420:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473425:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473431:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473436:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473441:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473447:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473453:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473458:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473463:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473469:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473474:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473478:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473483:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473488:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473494:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473499:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473504:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473510:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473515:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473520:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473525:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404972.473531:0:20727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1784404972.477827:0:20727:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd5589fe480 - data ffff9dd441cb7438/ffff9dd443281800 00000020:01000000:2.0:1784404972.479554:0:20727:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd5624f1900 - data ffff9dd5661c3d80/ffff9dd54a7b3000 00000020:00000080:2.0:1784404972.482834:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79e44 00000020:00000080:2.0:1784404972.484578:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd5462d4000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784404972.484651:0:20727:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd443e83000 from MGS, refs=2 00000020:01000004:2.0:1784404972.484674:0:20727:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd443e83000 2 00000020:01000004:2.0:1784404972.484677:0:20727:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd443e83000 from MGS 00000020:00000080:2.0:1784404972.484727:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784404972.484739:0:20727:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1784404972.484743:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd5462d4800/MGS 00000020:00000080:2.0:1784404972.484746:0:20727:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd5462d4800/MGS for MGS 00000020:01000000:2.0:1784404972.484757:0:20727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1784404972.484842:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1784404972.484846:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404972.484877:0:20727:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784404972.484885:0:20727:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9dd574d3a800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784404972.484892:0:20727:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9dd570464d40) has exports, disconnecting them 00000020:00080000:2.0:1784404972.484898:0:20727:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9dd574d3a800), last request at 1784404878 00000020:00000080:2.0:1784404972.484903:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79f47 00000020:00080000:2.0:1784404972.484915:0:20727:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd574d3a800): rc 0 00000020:00000080:2.0:1784404972.484920:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd574d3a800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784404972.487396:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd5462d4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784404972.488645:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd574d3a800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1784404972.503548:0:20727:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1784404972.503559:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784404972.503564:0:20727:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784404972.503571:0:20727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784404972.503776:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784404972.503786:0:20727:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1784404972.503793:0:20727:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd443e83000 1 00000020:00000080:2.0:1784404972.503801:0:20727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79e36 00000020:00000080:2.0:1784404972.503810:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd5462d3800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784404972.503838:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd574d39000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784404972.503845:0:36:0:(genops.c:885:class_export_put()) final put ffff9dd441a63000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1784404972.503847:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd441a63000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1784404972.503896:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1784404972.504413:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1784404972.504419:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404972.504424:0:20727:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784404972.504428:0:20727:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9dd573b1cd40) has no exports 00000020:00000080:1.0:1784404972.504935:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd5462d3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784404972.526772:0:20727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784404972.526785:0:20727:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1784404972.526791:0:20727:0:(genops.c:885:class_export_put()) final put ffff9dd443e85000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784404972.526795:0:20727:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443e85000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1784404972.526801:0:20727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1784404972.527030:0:20727:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dd443e86800 00000020:02000400:1.0:1784404972.527097:0:20727:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1784404972.867221:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404973.891678:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404974.471506:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784404974.471534:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729013632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784404974.471609:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404974.471704:0:19617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729013632 00000100:00100000:2.0:1784404974.471713:0:19617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729013632 00000100:00100000:2.0:1784404974.471789:0:19617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784404974.471799:0:19617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729013632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784404974.471827:0:19617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1784404974.471908:0:19617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729013632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404974.471917:0:19617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784404974.471970:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729013632:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784404974.472030:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784404974.916396:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784404975.299660:0:17906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1784404975.679504:0:20928:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1784404975.703530:0:20928:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1784404975.703583:0:20928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516e800/0x24b3e2e6dcd7a035 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a03c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.703599:0:20928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516e800/0x24b3e2e6dcd7a035 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a03c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.703607:0:20928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516e800/0x24b3e2e6dcd7a035 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a03c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.703613:0:20928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd54516e800/0x24b3e2e6dcd7a035 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a03c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.703640:0:20928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784404975.703645:0:20928:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784404975.703671:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784404975.703676:0:20928:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784404975.703681:0:20928:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784404975.703686:0:20928:0:(import.c:65:import_set_state_nolock()) ffff9dd4436ab000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1784404975.703691:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784404975.703709:0:20928:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784404975.703712:0:20928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784404975.704568:0:20928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516ea00/0x24b3e2e6dcd79f94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.704580:0:20928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516ea00/0x24b3e2e6dcd79f94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79f9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.704586:0:20928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516ea00/0x24b3e2e6dcd79f94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd79f9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.704593:0:20928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd54516ea00/0x24b3e2e6dcd79f94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd79f9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.704609:0:20928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784404975.704615:0:20928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a28f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.704622:0:20928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a28f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.704628:0:20928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a28f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.704635:0:20928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a28f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.704645:0:20928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784404975.704650:0:20928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7a41e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a425 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.704669:0:20928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7a41e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a425 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.704676:0:20928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7a41e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a425 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.704683:0:20928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7a41e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a425 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.704693:0:20928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1784404975.704698:0:20928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516fe00/0x24b3e2e6dcd79f86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd79f8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.704706:0:20928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516fe00/0x24b3e2e6dcd79f86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd79f8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.704711:0:20928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd54516fe00/0x24b3e2e6dcd79f86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd79f8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.704717:0:20928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd54516fe00/0x24b3e2e6dcd79f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd79f8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404975.704723:0:20928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:2.0:1784404975.704725:0:20928:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1784404975.704748:0:20928:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1784404975.704753:0:20928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1784404975.704758:0:20928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404975.704763:0:20928:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1784404975.704770:0:20928:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9dd441a28000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784404975.704782:0:20928:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9dd4435d3800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784404975.704787:0:20928:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9dd57d724d40) has exports, disconnecting them 00000020:00080000:2.0:1784404975.704791:0:20928:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9dd441a28000), last request at 1784404971 00000020:00000080:2.0:1784404975.704800:0:20928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a27a 00000100:00080000:2.0:1784404975.704822:0:20928:0:(import.c:65:import_set_state_nolock()) ffff9dd441a2d000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784404975.704902:0:20928:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd441a28000): rc 0 00000020:00000080:2.0:1784404975.704905:0:20928:0:(genops.c:885:class_export_put()) final put ffff9dd441a28000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1784404975.704914:0:20928:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9dd4435d3800), last request at 1784404971 00000020:00000080:2.0:1784404975.704916:0:20928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a115 00000100:00080000:2.0:1784404975.704923:0:20928:0:(import.c:65:import_set_state_nolock()) ffff9dd4435d6000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784404975.704928:0:20928:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd4435d3800): rc 0 00000020:00000080:2.0:1784404975.704930:0:20928:0:(genops.c:885:class_export_put()) final put ffff9dd4435d3800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1784404975.704935:0:20928:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffc2ae01c7bae0 00000100:00080000:2.0:1784404975.704952:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784404975.704961:0:20928:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9dd574d35180 x1871083729011712/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784404986 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784404975.704972:0:20928:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784404975.705723:0:20928:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784404975.705729:0:20928:0:(import.c:65:import_set_state_nolock()) ffff9dd577f59800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1784404975.705819:0:19705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784404975.705828:0:19705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd54516e800/0x24b3e2e6dcd7a035 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a03c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.705838:0:19705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516e800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784404975.705842:0:19705:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd54516e800/0x24b3e2e6dcd7a035 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a03c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.705879:0:19705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd54516e800/0x24b3e2e6dcd7a035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd7a03c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404975.705887:0:19705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd54516e800/0x24b3e2e6dcd7a035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd7a03c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404975.705893:0:19705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784404975.705896:0:19705:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784404975.705898:0:19705:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784404975.705937:0:19705:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd54516e800/0x24b3e2e6dcd7a035 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd7a03c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.705944:0:19705:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784404975.705969:0:19705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd54516e800/0x24b3e2e6dcd7a035 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd7a03c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.705977:0:19705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd54516e800/0x24b3e2e6dcd7a035 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd7a03c expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.705989:0:19705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784404975.705992:0:19705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd54516ea00/0x24b3e2e6dcd79f94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd79f9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.705997:0:19705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516ea00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784404975.706008:0:19705:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd54516ea00/0x24b3e2e6dcd79f94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd79f9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.706014:0:19705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd54516ea00/0x24b3e2e6dcd79f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd79f9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404975.706020:0:19705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd54516ea00/0x24b3e2e6dcd79f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd79f9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404975.706026:0:19705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784404975.706028:0:19705:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1784404975.706030:0:19705:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1784404975.706043:0:19705:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd54516ea00/0x24b3e2e6dcd79f94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79f9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.706048:0:19705:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784404975.706063:0:19705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd54516ea00/0x24b3e2e6dcd79f94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79f9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.706069:0:19705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd54516ea00/0x24b3e2e6dcd79f94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79f9b expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.706077:0:19705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784404975.706081:0:19705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a28f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.706087:0:19705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784404975.706090:0:19705:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a28f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.706096:0:19705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd7a28f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404975.706109:0:19705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd7a28f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404975.706114:0:19705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1784404975.706117:0:19705:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1784404975.706118:0:19705:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1784404975.706132:0:19705:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a288 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd7a28f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.706138:0:19705:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784404975.706144:0:19705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a288 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd7a28f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.706150:0:19705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a288 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd7a28f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.706163:0:19705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784404975.706167:0:19705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7a41e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a425 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.706173:0:19705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056c00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784404975.706175:0:19705:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7a41e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a425 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.706181:0:19705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7a41e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd7a425 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404975.706187:0:19705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7a41e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd7a425 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404975.706201:0:19705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1784404975.706204:0:19705:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1784404975.706206:0:19705:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1784404975.706219:0:19705:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7a41e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd7a425 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.706224:0:19705:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784404975.706230:0:19705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7a41e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd7a425 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.706247:0:19705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7a41e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd7a425 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.706256:0:19705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784404975.706260:0:19705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd54516fe00/0x24b3e2e6dcd79f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd79f8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.706265:0:19705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54516fe00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784404975.706268:0:19705:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd54516fe00/0x24b3e2e6dcd79f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd79f8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.706274:0:19705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd54516fe00/0x24b3e2e6dcd79f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd79f8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404975.706279:0:19705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd54516fe00/0x24b3e2e6dcd79f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd79f8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404975.706284:0:19705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1784404975.706286:0:19705:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1784404975.706287:0:19705:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1784404975.706306:0:19705:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd54516fe00/0x24b3e2e6dcd79f86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79f8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.706312:0:19705:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784404975.706317:0:19705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd54516fe00/0x24b3e2e6dcd79f86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79f8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.706322:0:19705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd54516fe00/0x24b3e2e6dcd79f86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x24b3e2e6dcd79f8d expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404975.706333:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404975.706335:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404975.706337:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784404975.706359:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083729014016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784404975.706432:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784404975.706484:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729011712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784404975.706507:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784404975.706513:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083729013888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784404975.706535:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784404975.707029:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404975.707037:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404975.707042:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784404975.707052:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd441a28000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1784404975.707104:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd4435d3800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1784404975.707126:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd441a2d000 for lustre-MDT0001 00000020:00000080:1.0:1784404975.707131:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd4435d6000 for lustre-MDT0001 00000100:00100000:1.0:1784404975.707145:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083729014144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784404975.707178:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404975.707214:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784404975.707220:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083729013760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784404975.707252:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404975.707267:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083729014272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784404975.707287:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784404975.707310:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729014016 00000100:00100000:1.0:1784404975.707317:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729014016 00000100:00100000:1.0:1784404975.707346:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729013888 00000100:00100000:1.0:1784404975.707349:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729013888 00000100:00100000:1.0:1784404975.707358:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729014144 00000100:00100000:1.0:1784404975.707360:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729014144 00000100:00100000:1.0:1784404975.707367:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729013760 00000100:00100000:1.0:1784404975.707369:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729013760 00000100:00100000:1.0:1784404975.707375:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729014272 00000100:00100000:1.0:1784404975.707377:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729014272 00000100:00100000:1.0:1784404975.707389:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784404975.707396:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3649:x1871083729014016:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1784404975.707412:0:17139:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784404975 with bad export cookie 2644706887372086880 00000100:00100000:0.0:1784404975.709084:0:20728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784404975.709096:0:20728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1871083729013888:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1784404975.709104:0:20728:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784404975 with bad export cookie 2644706887372086880 00000100:00100000:0.0:1784404975.709191:0:20728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1871083729013888:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (2653us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784404975.709198:0:20728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784404975.709226:0:20728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784404975.709230:0:20728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1871083729014144:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1784404975.709247:0:20728:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784404975 with bad export cookie 2644706887372086880 00000100:00100000:0.0:1784404975.709299:0:20728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1871083729014144:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (2120us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784404975.709306:0:20728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784404975.709321:0:20728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784404975.709325:0:20728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1871083729013760:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1784404975.709330:0:20728:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784404975 with bad export cookie 2644706887372086880 00000100:00100000:0.0:1784404975.709354:0:20728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1871083729013760:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (2101us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784404975.709361:0:20728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784404975.709373:0:20728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784404975.709378:0:20728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1871083729014272:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1784404975.709382:0:20728:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784404975 with bad export cookie 2644706887372086880 00000100:00100000:0.0:1784404975.709408:0:20728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1871083729014272:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (2119us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784404975.709414:0:20728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1784404975.709453:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.142@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784404975.709458:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9dd443e84800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1784404975.709462:0:3649:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.142@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1784404975.713415:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784404975.713424:0:20928:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1784404975.713442:0:20928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784404975.713513:0:20928:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1784404975.713541:0:20928:0:(import.c:65:import_set_state_nolock()) ffff9dd443583000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1784404975.713561:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784404975.713563:0:20928:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1784404975.713572:0:20928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784404975.713644:0:20928:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1784404975.713654:0:20928:0:(import.c:65:import_set_state_nolock()) ffff9dd548765000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1784404975.713694:0:20928:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9dd57d724d40) has no exports 00000100:00100000:2.0:1784404975.713746:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729014400:0@lo:9:umount.0 00000100:00100000:2.0:1784404975.713823:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404975.714867:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729014528:0@lo:9:umount.0 00000100:00100000:2.0:1784404975.714903:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784404975.714941:0:19703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729014400 00000100:00100000:2.0:1784404975.714950:0:19703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729014400 00000100:00100000:2.0:1784404975.714995:0:19703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729014528 00000100:00100000:2.0:1784404975.714999:0:19703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729014528 00000100:00100000:2.0:1784404975.715030:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784404975.715039:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1871083729014400:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784404975.715063:0:19703:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a13f 00000100:00080000:2.0:1784404975.715071:0:19703:0:(import.c:65:import_set_state_nolock()) ffff9dd4435d0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784404975.715108:0:19703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1784404975.715252:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3645:x1871083729014400:12345-0@lo:9:umount.0 Request processed in 214us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404975.715260:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784404975.715275:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784404975.715282:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1871083729014528:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784404975.715292:0:19703:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a2ab 00000100:00080000:2.0:1784404975.715298:0:19703:0:(import.c:65:import_set_state_nolock()) ffff9dd442085800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784404975.715319:0:19703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1784404975.715397:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3645:x1871083729014528:12345-0@lo:9:umount.0 Request processed in 116us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1784404975.715404:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1784404975.715430:0:17150:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784404975.715582:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784404975.715614:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd443583000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784404975.715625:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784404975.715626:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784404975.715630:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729014400:0@lo:9:umount.0 00000100:00080000:2.0:1784404975.715642:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd548765000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784404975.715650:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784404975.715652:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784404975.715654:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729014528:0@lo:9:umount.0 00010000:00010000:1.0:1784404975.722026:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784404975.722072:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.142@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000001:00100000:2.0:1784404975.726488:0:19474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784404975.726497:0:19474:0:(genops.c:885:class_export_put()) final put ffff9dd442083000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1784404975.726520:0:19474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784404975.726522:0:19474:0:(genops.c:885:class_export_put()) final put ffff9dd442085000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784404975.726541:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd442083000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784404975.726589:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd442085000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784404975.726603:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd442085800 for lustre-OST0001 00000020:00000080:2.0:1784404975.726607:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd442086800 for lustre-OST0001 00000100:00100000:2.0:1784404975.728307:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3649:x1871083729014016:12345-0@lo:103:ldlm_bl.0 Request processed in 20903us (21868us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784404975.728320:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1784404975.754573:0:3649:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.142@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1784404975.754579:0:3649:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1784404975.754590:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd570592680 x1871083729014016/t0(0) o103->MGC192.168.202.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784404991 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404975.754605:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd570590000 x1871083729013888/t0(0) o103->MGC192.168.202.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784404991 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404975.754616:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd570593100 x1871083729014144/t0(0) o103->MGC192.168.202.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784404991 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404975.754650:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd570591f80 x1871083729013760/t0(0) o103->MGC192.168.202.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784404991 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404975.754658:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd570590e00 x1871083729014272/t0(0) o103->MGC192.168.202.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784404991 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784404975.754775:0:3646:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9dd443e84800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1784404975.754820:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083729014272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784404975.754829:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083729014144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784404975.754996:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3646:1871083729013760:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1784404975.755330:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1784404975.755334:0:3649:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1784404975.755336:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1784404975.755339:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9dd443e84800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784404975.755344:0:3649:0:(import.c:510:import_select_connection()) MGC192.168.202.142@tcp: connect to NID 0@lo last attempt 495 00000100:00080000:0.0:1784404975.755354:0:3649:0:(import.c:624:import_select_connection()) MGC192.168.202.142@tcp: import ffff9dd443e84800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404975.755436:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd5732b8a80 x1871083729014656/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784404975.755470:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083729014016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784404975.755483:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3649:1871083729013888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784404975.755549:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3645:1871083729014656:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1784404975.755596:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871083729014656 offset 0 length 520: 4 00000020:00080000:0.0:1784404975.757564:0:20928:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9dd57d724d40) has no exports 00000020:01000000:2.0:1784404975.835973:0:20928:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd441b23240 - data ffff9dd5663201b0/ffff9dd442059800 00000020:01000000:2.0:1784404975.836162:0:20928:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd44314f060 - data ffff9dd5603f0000/ffff9dd5445f2c00 00000001:00000004:3.0:1784404975.848223:0:20928:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1784404975.907271:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784404975.907286:0:20928:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784404975.907295:0:20928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1784404975.908624:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784404975.908630:0:20928:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1784404975.908748:0:20928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784404975.908752:0:20928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784404975.920884:0:17894:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784404975.920892:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1784404975.920911:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1784404975.921910:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784404975.921916:0:20928:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1784404975.921940:0:20928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784404975.921943:0:20928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784404975.922251:0:17896:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784404975.922255:0:17896:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1784404975.922262:0:17896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1784404975.923081:0:20928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79fa9 00000020:00000080:2.0:1784404975.923091:0:20928:0:(genops.c:885:class_export_put()) final put ffff9dd4436aa800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1784404975.923148:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd4436aa800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1784404975.923753:0:20928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79fbe 00000020:00000080:2.0:1784404975.923759:0:20928:0:(genops.c:885:class_export_put()) final put ffff9dd57395c000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1784404975.923776:0:20928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1784404975.923782:0:20928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404975.923792:0:20928:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784404975.923797:0:20928:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9dd57d720000) has no exports 00000004:01000000:2.0:1784404975.923987:0:20928:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1784404975.923994:0:20928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a012 00000020:00000080:2.0:1784404975.923998:0:20928:0:(genops.c:885:class_export_put()) final put ffff9dd548766800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1784404975.924002:0:20928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1784404975.924005:0:20928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404975.924010:0:20928:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784404975.924013:0:20928:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9dd442138000) has no exports 00000020:00000080:2.0:1784404975.924018:0:20928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a00b 00000020:00000080:2.0:1784404975.924021:0:20928:0:(genops.c:885:class_export_put()) final put ffff9dd548763000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1784404975.924127:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd57395c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1784404975.924136:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd548766800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1784404975.924140:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd548763000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1784404975.924891:0:20928:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1784404975.924896:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784404975.924900:0:20928:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1784404975.924906:0:20928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784404975.924908:0:20928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784404975.924969:0:20928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784404975.924977:0:20928:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784404975.924984:0:20928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79ffd 00000020:00000080:1.0:1784404975.924991:0:20928:0:(genops.c:885:class_export_put()) final put ffff9dd443584000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1784404975.925006:0:20928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1784404975.925011:0:20928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784404975.925014:0:20928:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784404975.925019:0:20928:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9dd573a88000) has no exports 00000020:00000080:1.0:1784404975.925024:0:20928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79ff6 00000020:00000080:1.0:1784404975.925098:0:20928:0:(genops.c:885:class_export_put()) final put ffff9dd443582800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1784404975.925445:0:20928:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1784404975.925448:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784404975.925451:0:20928:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1784404975.925454:0:20928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784404975.925455:0:20928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784404975.925483:0:20928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784404975.925487:0:20928:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1784404975.925499:0:20928:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1784404975.925504:0:20928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79fe1 00000020:00000080:1.0:1784404975.925508:0:20928:0:(genops.c:885:class_export_put()) final put ffff9dd443587800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1784404975.925512:0:20928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1784404975.925516:0:20928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784404975.925519:0:20928:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784404975.925521:0:20928:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9dd573a899c0) has no exports 00000020:00000080:1.0:1784404975.925526:0:20928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79fda 00000020:00000080:1.0:1784404975.925528:0:20928:0:(genops.c:885:class_export_put()) final put ffff9dd574f23000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1784404975.925991:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd548765000 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1784404975.926000:0:37:0:(genops.c:885:class_export_put()) final put ffff9dd443582000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784404975.926003:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443582000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1784404975.926009:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784404975.927004:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443584000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1784404975.927014:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443582800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1784404975.927020:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd443583000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1784404975.927024:0:37:0:(genops.c:885:class_export_put()) final put ffff9dd443587000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784404975.927026:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443587000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1784404975.927178:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784404975.927225:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443587800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1784404975.927240:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd574f23000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1784404975.957361:0:20928:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1784404975.957371:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784404975.957376:0:20928:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784404975.957385:0:20928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784404975.957463:0:20928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784404975.957475:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd577f59800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1784404975.957475:0:20928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784404975.957487:0:37:0:(genops.c:885:class_export_put()) final put ffff9dd574f22800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784404975.957490:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd574f22800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1784404975.957502:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784404975.957513:0:20928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784404975.957517:0:20928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784404975.957521:0:20928:0:(genops.c:885:class_export_put()) final put ffff9dd44254e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784404975.957523:0:20928:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd44254e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1784404975.957531:0:20928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784404975.957701:0:20928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79fc5 00000020:00000080:1.0:1784404975.957707:0:20928:0:(genops.c:885:class_export_put()) final put ffff9dd573959000/lustre-MDD0001_UUID 00000020:01000000:1.0:1784404975.957724:0:20928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1784404975.957728:0:20928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784404975.957741:0:20928:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784404975.957745:0:20928:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9dd57d7219c0) has no exports 00000020:00000080:1.0:1784404975.957772:0:20928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784404975.957776:0:20928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1784404975.957782:0:20928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79fcc 00000020:00000080:1.0:1784404975.957787:0:20928:0:(genops.c:885:class_export_put()) final put ffff9dd573958800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1784404975.957793:0:20928:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd442285000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1784404975.957801:0:20928:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd442285000 2 00000020:01000004:1.0:1784404975.957804:0:20928:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd442285000 from lustre-MDT0001 00000020:00000080:1.0:1784404975.957825:0:20928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784404975.957829:0:20928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1784404975.957832:0:20928:0:(genops.c:885:class_export_put()) final put ffff9dd4436ab800/lustre-MDT0001_UUID 00000020:00000080:1.0:1784404975.957834:0:20928:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd4436ab800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1784404975.957841:0:20928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1784404975.957889:0:20928:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1784404975.957894:0:20928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1784404975.957897:0:20928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784404975.957901:0:20928:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784404975.957907:0:20928:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9dd577f05000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784404975.957913:0:20928:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9dd5445fb380) has exports, disconnecting them 00000020:00080000:1.0:1784404975.957929:0:20928:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9dd577f05000), last request at 1784404893 00000020:00000080:1.0:1784404975.957933:0:20928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a04a 00000020:00080000:1.0:1784404975.957943:0:20928:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd577f05000): rc 0 00000020:00000080:1.0:1784404975.957947:0:20928:0:(genops.c:885:class_export_put()) final put ffff9dd577f05000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1784404975.957979:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573959000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1784404975.957985:0:37:0:(genops.c:885:class_export_put()) final put ffff9dd4436ae000/lustre-MDD0001_UUID 00000020:00000080:2.0:1784404975.957987:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd4436ae000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1784404975.957991:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1784404975.958095:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573958800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1784404975.958100:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd577f05000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1784404976.011509:0:20928:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1784404976.011519:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784404976.011524:0:20928:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784404976.011531:0:20928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784404976.011706:0:20928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784404976.011716:0:20928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1784404976.011723:0:20928:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd442285000 1 00000020:00000080:1.0:1784404976.011743:0:20928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79f71 00000020:00000080:1.0:1784404976.011752:0:20928:0:(genops.c:885:class_export_put()) final put ffff9dd573a39800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1784404976.011758:0:20928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1784404976.011763:0:20928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784404976.011769:0:20928:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784404976.011773:0:20928:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9dd573a8cd40) has no exports 00000020:00000080:0.0:1784404976.014312:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd4436ab000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1784404976.014328:0:36:0:(genops.c:885:class_export_put()) final put ffff9dd57395b800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1784404976.014331:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd57395b800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1784404976.014344:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1784404976.014417:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573a39800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1784404976.034051:0:20928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784404976.034066:0:20928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1784404976.034072:0:20928:0:(genops.c:885:class_export_put()) final put ffff9dd443680800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1784404976.034077:0:20928:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443680800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1784404976.034087:0:20928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1784404976.034207:0:20928:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dd443681000 00000020:01000000:0.0:1784404976.034248:0:20928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1784404976.034253:0:20928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784404976.034258:0:20928:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784404976.034261:0:20928:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9dd573b1b380) has no exports 00000100:00100000:1.0:1784404976.034468:0:17153:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9dd5739aae00:17153] 0 exiting: rc = 1 00000100:00100000:2.0:1784404976.034640:0:17154:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9dd5739ab600:17154] 1 exiting: rc = 0 00000100:00100000:2.0:1784404976.034713:0:17155:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9dd5739ab800:17155] 2 exiting: rc = 0 00000100:00100000:2.0:1784404976.034782:0:18438:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9dd5436ea200:18438] 3 exiting: rc = 0 00000100:00100000:0.0:1784404976.035220:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035242:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035251:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035257:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035273:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035281:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035289:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035296:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035301:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035306:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035311:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035317:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035322:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035327:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035333:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035340:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035345:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035351:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035358:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035364:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035371:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035377:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035383:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035388:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035393:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035398:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035403:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035407:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035413:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035419:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035425:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035446:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035452:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035458:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035464:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035469:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035475:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035480:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035485:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035490:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035494:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035500:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035507:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035512:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035517:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035524:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035530:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035536:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035541:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035546:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035552:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035557:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035562:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035568:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035574:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035578:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035583:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035588:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035593:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035598:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035603:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035607:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035612:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.035616:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.038832:0:17157:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9dd5739aac00:17157] 1 exiting: rc = 0 00000100:00100000:2.0:1784404976.039000:0:17156:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9dd5739abe00:17156] 0 exiting: rc = 1 00000100:00100000:0.0:1784404976.039095:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039104:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039124:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039184:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039190:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039196:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039202:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039208:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039213:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039219:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039225:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039239:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039245:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039250:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039255:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039260:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039264:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039269:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039273:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039278:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039283:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039287:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039292:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039296:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039301:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039305:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039310:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039314:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039318:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039323:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039328:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039332:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039336:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039341:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039345:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039351:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039357:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039371:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039377:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039382:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039390:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039394:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039399:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039403:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039408:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039414:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039419:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039944:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039955:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039960:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039965:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039969:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039974:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039979:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039984:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039989:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.039995:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.040000:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.040006:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.040011:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.040016:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.040022:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.040027:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.040033:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.040646:0:17159:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9dd4437aaa00:17159] 1 exiting: rc = 0 00000100:00100000:2.0:1784404976.040723:0:17158:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9dd4437aae00:17158] 0 exiting: rc = 1 00000100:00100000:1.0:1784404976.040824:0:18181:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9dd565e82000:18181] 2 exiting: rc = 0 00000100:00100000:0.0:1784404976.041004:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041012:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041027:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041034:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041040:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041046:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041052:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041057:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041073:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041079:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041085:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041091:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041097:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041105:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041126:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041144:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041149:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041155:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041161:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041173:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041179:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041184:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041190:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041197:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041203:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041208:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041228:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041247:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041253:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041261:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041266:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041273:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041278:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041284:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041290:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041296:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041302:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041308:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041330:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041337:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041342:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041348:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041355:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041367:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041373:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041379:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041384:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041390:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041396:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041401:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041420:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041429:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041435:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041442:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041449:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041455:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041461:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041467:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041473:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041479:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041484:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041489:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041495:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.041502:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.050393:0:17160:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9dd5494df000:17160] 0 exiting: rc = 1 00000100:00100000:1.0:1784404976.050534:0:17161:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9dd4437ab200:17161] 1 exiting: rc = 0 00000100:00100000:0.0:1784404976.050636:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050643:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050648:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050654:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050660:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050665:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050669:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050674:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050679:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050685:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050691:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050696:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050701:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050706:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050723:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050729:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050734:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050740:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050746:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050751:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050757:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050763:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050767:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050772:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050777:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050782:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050787:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050793:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050798:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050803:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050808:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050813:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050818:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050824:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050829:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050834:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050840:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050846:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050971:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050979:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050984:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050989:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050994:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.050999:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051005:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051010:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051016:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051021:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051026:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051038:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051043:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051048:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051054:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051059:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051064:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051070:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051075:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051080:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051086:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051091:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051097:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051102:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051107:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.051113:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.051715:0:17162:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9dd4434a2800:17162] 0 exiting: rc = 1 00000100:00100000:1.0:1784404976.052258:0:17163:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9dd4434a2200:17163] 1 exiting: rc = 0 00000100:00100000:0.0:1784404976.052606:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052615:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052619:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052625:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052630:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052635:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052640:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052645:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052650:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052655:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052660:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052665:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052670:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052676:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052681:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052687:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052692:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052697:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052702:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052706:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052724:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052730:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052735:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052740:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052744:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052749:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052753:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052758:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052763:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052768:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052773:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052779:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052784:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052789:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052795:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052800:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052805:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052810:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052815:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052820:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052825:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052832:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052837:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052841:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.052847:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.053012:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.053018:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.053023:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.053028:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.053032:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.053038:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.053042:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.053047:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.053052:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.053057:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.053070:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.053074:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.053079:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.053083:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.053088:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.053093:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.053099:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.053104:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404976.053109:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.053581:0:17165:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9dd4434a3200:17165] 1 exiting: rc = 0 00000100:00100000:0.0:1784404976.054253:0:17164:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9dd4434a3600:17164] 0 exiting: rc = 1 00000100:00100000:1.0:1784404976.054598:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054605:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054610:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054615:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054620:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054626:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054631:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054636:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054641:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054646:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054651:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054655:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054660:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054666:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054671:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054676:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054681:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054686:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054691:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054695:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054700:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054704:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054709:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054723:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054728:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054734:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054739:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054744:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054749:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054754:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054758:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054762:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054767:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054772:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054777:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054782:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054786:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054792:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054797:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054802:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054807:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054811:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054816:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054820:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054825:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054830:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054835:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054840:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.054844:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.055303:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.055314:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.055319:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.055323:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.055329:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.055334:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.055339:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.055344:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.055348:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.055363:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.055368:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.055373:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.055378:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.055383:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404976.055389:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.055946:0:17168:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9dd574e3ba00:17168] 2 exiting: rc = 0 00000100:00100000:0.0:1784404976.056177:0:17166:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9dd442407400:17166] 0 exiting: rc = 1 00000100:00100000:1.0:1784404976.056471:0:17167:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9dd56d400e00:17167] 1 exiting: rc = 0 00000100:00100000:2.0:1784404976.056570:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056578:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056585:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056601:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056609:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056616:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056622:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056628:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056634:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056639:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056645:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056650:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056656:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056660:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056666:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056671:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056677:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056682:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056687:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056693:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056709:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056716:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056722:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056728:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056732:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056737:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056743:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056749:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056755:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056761:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056766:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056771:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056778:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056783:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056801:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056807:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056813:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056819:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056825:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056831:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056837:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056843:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056848:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056888:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056907:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056916:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056921:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056926:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056933:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056938:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056943:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056950:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056957:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056962:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056968:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056974:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056979:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056986:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056992:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.056997:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.057003:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.057008:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.057014:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404976.057020:0:20928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1784404976.062469:0:20928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784404976.062482:0:20928:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1784404976.062488:0:20928:0:(genops.c:885:class_export_put()) final put ffff9dd5462d6000/MDS_uuid 00000020:00000080:2.0:1784404976.062492:0:20928:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd5462d6000/MDS_uuid for MDS 00000020:01000000:2.0:1784404976.062499:0:20928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1784404976.062656:0:20928:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1784404976.156061:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784404976.517886:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fccb8c6c-dea6-48fe-a863-d61ae2c1427e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784404976.517896:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) fccb8c6c-dea6-48fe-a863-d61ae2c1427e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784404976.517899:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784404976.517903:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784404976.517906:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd442662000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784404976.518029:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 589 00000100:00080000:0.0:1784404976.518035:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784404976.518044:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dd442662000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784404976.518086:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd570591180 x1871083729014784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784404976.518136:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784404976.518140:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784404976.518142:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd4433f8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784404976.518146:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 589 00000100:00080000:0.0:1784404976.518148:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784404976.518151:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dd4433f8000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784404976.518176:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd570591880 x1871083729015040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784404976.518213:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083729014912:0@lo:400:kworker.0 00000400:00000100:0.0:1784404976.518279:0:3648:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083729014912 offset 0 length 224: 4 00000100:00100000:0.0:1784404976.518319:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784404976.518325:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083729015168:0@lo:400:kworker.0 00000400:00000100:0.0:1784404976.518355:0:3648:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083729015168 offset 0 length 224: 4 00000100:00100000:3.0:1784404976.518411:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1871083729014784:0@lo:38:kworker.0 00000400:00000100:3.0:1784404976.518434:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083729014784 offset 0 length 520: 4 00000100:00100000:3.0:1784404976.518449:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083729015040:0@lo:38:kworker.0 00000400:00000100:3.0:1784404976.518462:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083729015040 offset 0 length 520: 4 00010000:00010000:3.0:1784404977.222949:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404978.243374:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404979.268189:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784404979.845744:0:21130:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1784404979.861230:0:21130:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1784404979.861288:0:21130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548758a00/0x24b3e2e6dcd7a0e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a0eb expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404979.861307:0:21130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548758a00/0x24b3e2e6dcd7a0e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a0eb expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404979.861315:0:21130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd548758a00/0x24b3e2e6dcd7a0e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a0eb expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404979.861323:0:21130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd548758a00/0x24b3e2e6dcd7a0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a0eb expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404979.861358:0:21130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784404979.861364:0:21130:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1784404979.861391:0:21130:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784404979.861404:0:21130:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd570591180 x1871083729014784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784404991 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404979.861422:0:21130:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784404979.861429:0:21130:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784404979.861449:0:21130:0:(import.c:65:import_set_state_nolock()) ffff9dd442662000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1784404979.861454:0:21130:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784404979.861459:0:21130:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd570591180 x1871083729014784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784404991 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404979.861465:0:21130:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784404979.861469:0:21130:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:1.0:1784404979.861628:0:19706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784404979.861635:0:19706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd548758a00/0x24b3e2e6dcd7a0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a0eb expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404979.861643:0:19706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758a00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404979.861648:0:19706:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd548758a00/0x24b3e2e6dcd7a0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a0eb expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404979.861657:0:19706:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd548758a00/0x24b3e2e6dcd7a0e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd7a0eb expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404979.861665:0:19706:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd548758a00/0x24b3e2e6dcd7a0e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd7a0eb expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404979.861670:0:19706:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784404979.861673:0:19706:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784404979.861676:0:19706:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784404979.861689:0:19706:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd443e84800 00010000:00010000:1.0:1784404979.861693:0:19706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd548758a00/0x24b3e2e6dcd7a0e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd7a0eb expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404979.861699:0:19706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd548758a00/0x24b3e2e6dcd7a0e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd7a0eb expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404979.861721:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404979.861723:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404979.861725:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404979.861766:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1871083729014784:0@lo:38:kworker.0 00000100:00080000:0.0:1784404979.863822:0:21130:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784404979.863841:0:21130:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd570590a80 x1871083729014912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404992 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784404979.863881:0:21130:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784404979.863887:0:21130:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1784404979.863915:0:21130:0:(import.c:65:import_set_state_nolock()) ffff9dd442660000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1784404979.864006:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083729014912:0@lo:400:kworker.0 00000100:00100000:1.0:1784404979.864040:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1871083729015296:0@lo:39:umount.0 00000400:00000100:1.0:1784404979.864086:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083729015296 offset 0 length 224: 4 00010000:00010000:3.0:1784404980.291286:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784404980.547110:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) fccb8c6c-dea6-48fe-a863-d61ae2c1427e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784404980.547121:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) fccb8c6c-dea6-48fe-a863-d61ae2c1427e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784404980.547125:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784404980.547128:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784404980.547285:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083729015424:0@lo:400:kworker.0 00000400:00000100:2.0:1784404980.547359:0:3646:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083729015424 offset 0 length 224: 4 00000001:00100000:3.0:1784404981.127230:0:18656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784404981.127240:0:18656:0:(genops.c:885:class_export_put()) final put ffff9dd4435d6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784404981.127347:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd4435d6800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1784404981.127402:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd4435d0800 for lustre-OST0000 00010000:00010000:0.0:1784404981.315502:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784404981.570999:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) fccb8c6c-dea6-48fe-a863-d61ae2c1427e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784404981.571010:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) fccb8c6c-dea6-48fe-a863-d61ae2c1427e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784404981.571013:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784404981.571017:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784404981.571140:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784404981.571163:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083729015552:0@lo:400:kworker.0 00000400:00000100:2.0:1784404981.571234:0:3646:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083729015552 offset 0 length 224: 4 00010000:00010000:1.0:1784404982.342339:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404983.363100:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404984.387052:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784404985.413182:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404985.987359:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784404975/real 1784404975] req@ffff9dd5732b8a80 x1871083729014656/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784404985 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404985.987397:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd5732b8a80 x1871083729014656/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784404985 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784404985.987444:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd443e84800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784404985.987473:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1784404985.987478:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3645:1871083729014656:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1784404985.987589:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fccb8c6c-dea6-48fe-a863-d61ae2c1427e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784404985.987594:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1784404985.987597:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd443e84800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784404985.987603:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.142@tcp: connect to NID 0@lo last attempt 593 00000100:00080000:0.0:1784404985.987608:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.142@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784404985.987614:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.142@tcp: import ffff9dd443e84800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784404985.987643:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd570593800 x1871083729015680/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784404985.987669:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784404985.987673:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784404985.987771:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3645:1871083729015680:0@lo:250:kworker.0 00000400:00000100:1.0:1784404985.987818:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871083729015680 offset 0 length 520: 4 00000100:00100000:3.0:1784404985.987886:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784404985.987900:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083729015808:0@lo:400:kworker.0 00000400:00000100:3.0:1784404985.987946:0:3649:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083729015808 offset 0 length 224: 4 00010000:00010000:0.0:1784404986.435620:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404987.459309:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404988.483162:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404989.058944:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784404979/real 1784404979] req@ffff9dd570592d80 x1871083729015296/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784404989 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404989.058989:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd570592d80 x1871083729015296/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784404989 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784404989.059009:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd442660000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784404989.059029:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1871083729015296:0@lo:39:umount.0 00000100:00080000:0.0:1784404989.059083:0:21130:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784404989.059105:0:21130:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784404989.059110:0:21130:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1784404989.060440:0:21130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a0ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a0c1 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404989.060458:0:21130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a0ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a0c1 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404989.060466:0:21130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a0ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a0c1 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404989.060474:0:21130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a0ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a0c1 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404989.060501:0:21130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784404989.060508:0:21130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7a410 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a417 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404989.060516:0:21130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7a410 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a417 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404989.060523:0:21130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7a410 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a417 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404989.060530:0:21130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7a410 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a417 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404989.060550:0:21130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1784404989.060554:0:21130:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1784404989.060581:0:21130:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1784404989.060585:0:21130:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1784404989.060600:0:21130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784404989.060605:0:21130:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784404989.060610:0:21130:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9dd5445fcd40) has no exports 00000020:00080000:0.0:1784404989.060634:0:21130:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9dd5445fcd40) has no exports 00010000:00010000:1.0:1784404989.060663:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784404989.060670:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a0ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a0c1 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404989.060679:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7e00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404989.060683:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a0ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a0c1 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404989.060692:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a0ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd7a0c1 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404989.060700:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a0ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd7a0c1 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404989.060716:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784404989.060719:0:17142:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1784404989.060721:0:17142:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1784404989.060735:0:17142:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd443e84800 00010000:00010000:1.0:1784404989.060739:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a0ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd7a0c1 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404989.060746:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a0ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd7a0c1 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404989.060762:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784404989.060765:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7a410 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a417 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404989.060770:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404989.060773:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7a410 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a417 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404989.060780:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7a410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd7a417 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404989.060786:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7a410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd7a417 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404989.060791:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1784404989.060793:0:17142:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1784404989.060794:0:17142:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1784404989.060798:0:17142:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd443e84800 00010000:00010000:1.0:1784404989.060801:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7a410 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd7a417 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404989.060812:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7a410 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd7a417 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404989.060821:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404989.060822:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404989.060824:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784404989.061090:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1784404989.076666:0:21130:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd4435616c0 - data ffff9dd5492b6288/ffff9dd544569000 00000020:01000000:1.0:1784404989.076787:0:21130:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd4427d2d20 - data ffff9dd5661ac6c0/ffff9dd5759f9800 00100000:10000000:1.0:1784404989.090963:0:21130:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1784404989.103753:0:21130:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a0cf 00000020:00000080:2.0:1784404989.103771:0:21130:0:(genops.c:885:class_export_put()) final put ffff9dd5441d4000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1784404989.103798:0:21130:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd573845800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1784404989.103802:0:21130:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd573845800 2 00000020:01000004:2.0:1784404989.103806:0:21130:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd573845800 from lustre-OST0000 00000020:00000080:2.0:1784404989.103838:0:21130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784404989.103878:0:21130:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1784404989.103882:0:21130:0:(genops.c:885:class_export_put()) final put ffff9dd5441d3800/lustre-OST0000_UUID 00000020:00000080:2.0:1784404989.103885:0:21130:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd5441d3800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1784404989.103894:0:21130:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1784404989.103972:0:21130:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1784404989.103978:0:21130:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1784404989.103984:0:21130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404989.103990:0:21130:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784404989.104000:0:21130:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9dd442667800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784404989.104007:0:21130:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9dd573b04d40) has exports, disconnecting them 00000020:00080000:2.0:1784404989.104014:0:21130:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9dd442667800), last request at 1784404908 00000020:00000080:2.0:1784404989.104019:0:21130:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a0f9 00000020:00080000:2.0:1784404989.104030:0:21130:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd442667800): rc 0 00000020:00000080:2.0:1784404989.104068:0:21130:0:(genops.c:885:class_export_put()) final put ffff9dd442667800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1784404989.104934:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd5441d4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1784404989.104956:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd442667800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1784404989.110757:0:21130:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1784404989.110770:0:21130:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784404989.110776:0:21130:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784404989.110787:0:21130:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784404989.111154:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd442662000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1784404989.111252:0:21130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784404989.111330:0:21130:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1784404989.111337:0:21130:0:(genops.c:885:class_export_put()) final put ffff9dd442664000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1784404989.111342:0:21130:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd442664000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1784404989.111358:0:21130:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1784404989.111459:0:21130:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1784404989.111465:0:21130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784404989.111471:0:21130:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784404989.111481:0:21130:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9dd442661800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784404989.111488:0:21130:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9dd573b00000) has exports, disconnecting them 00000020:00080000:3.0:1784404989.111494:0:21130:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9dd442661800), last request at 1784404908 00000020:00000080:3.0:1784404989.111499:0:21130:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a10e 00000020:00080000:3.0:1784404989.111517:0:21130:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd442661800): rc 0 00000020:00000080:3.0:1784404989.111523:0:21130:0:(genops.c:885:class_export_put()) final put ffff9dd442661800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1784404989.111698:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd442661800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1784404989.126974:0:21130:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1784404989.126988:0:21130:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784404989.126994:0:21130:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784404989.127005:0:21130:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784404989.127044:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd442660000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1784404989.127265:0:21130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784404989.127278:0:21130:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1784404989.127286:0:21130:0:(genops.c:885:class_export_put()) final put ffff9dd442667000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1784404989.127291:0:21130:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd442667000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1784404989.127305:0:21130:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1784404989.127408:0:21130:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd573845800 1 00000020:00000080:0.0:1784404989.127418:0:21130:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a0ac 00000020:00000080:0.0:1784404989.127427:0:21130:0:(genops.c:885:class_export_put()) final put ffff9dd443cf2800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1784404989.127440:0:21130:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1784404989.127451:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443cf2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1784404989.127462:0:21130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784404989.127468:0:21130:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784404989.127473:0:21130:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9dd570460000) has no exports 00000020:00000080:0.0:1784404989.305214:0:21130:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784404989.305231:0:21130:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1784404989.305238:0:21130:0:(genops.c:885:class_export_put()) final put ffff9dd573843000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1784404989.305243:0:21130:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573843000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1784404989.305271:0:21130:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1784404989.305395:0:21130:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dd573845000 00000020:02000400:0.0:1784404989.305443:0:21130:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1784404989.508957:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404990.531054:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784404991.114534:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784404976/real 1784404976] req@ffff9dd570591880 x1871083729015040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1784404991 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784404991.114567:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd570591880 x1871083729015040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1784404991 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784404991.114588:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd4433f8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784404991.114611:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784404991.114616:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083729015040:0@lo:38:kworker.0 00000100:00080000:2.0:1784404991.121456:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) fccb8c6c-dea6-48fe-a863-d61ae2c1427e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784404991.121469:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) fccb8c6c-dea6-48fe-a863-d61ae2c1427e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784404991.121472:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784404991.121477:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784404991.121481:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd4433f8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784404991.121490:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 594 00000100:00080000:2.0:1784404991.121497:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784404991.121504:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dd4433f8000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404991.121556:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd5732b8380 x1871083729015936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784404991.121635:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083729015936:0@lo:38:kworker.0 00000100:00100000:2.0:1784404991.121643:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784404991.121659:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083729016064:0@lo:400:kworker.0 00000400:00000100:3.0:1784404991.121699:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083729015936 offset 0 length 520: 4 00000400:00000100:2.0:1784404991.133582:0:3648:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083729016064 offset 0 length 224: 4 00010000:00010000:3.0:1784404991.557540:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1784404992.196713:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784404976/real 1784404976] req@ffff9dd570593b80 x1871083729015168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784404992 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404992.220631:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9dd570593b80 x1871083729015168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784404992 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784404992.220648:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9dd4433f8800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784404992.220652:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784404992.250368:0:3648:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:3.0:1784404992.250416:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083729015168:0@lo:400:kworker.0 00000100:00080000:2.0:1784404992.250510:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fccb8c6c-dea6-48fe-a863-d61ae2c1427e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784404992.250515:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) fccb8c6c-dea6-48fe-a863-d61ae2c1427e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784404992.250518:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784404992.250521:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784404992.250523:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784404992.250526:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1784404992.250529:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd4433f8800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784404992.250535:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 543 00000100:00080000:2.0:1784404992.250542:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9dd4433f8800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784404992.250578:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd5732bb480 x1871083729016192/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784404992.250659:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1871083729016192:0@lo:38:kworker.0 00000400:00000100:0.0:1784404992.250740:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871083729016192 offset 0 length 520: 4 00010000:00010000:1.0:1784404992.579455:0:19705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784404993.206500:0:21332:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1784404993.229152:0:21332:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1784404993.229244:0:21332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a249 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a250 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404993.229261:0:21332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a249 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a250 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404993.229268:0:21332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a249 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a250 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404993.229276:0:21332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a250 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784404993.229352:0:21332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784404993.229359:0:21332:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784404993.229386:0:21332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784404993.229398:0:21332:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd5732b8380 x1871083729015936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784405011 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404993.229418:0:21332:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784404993.229424:0:21332:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784404993.229445:0:21332:0:(import.c:65:import_set_state_nolock()) ffff9dd4433f8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1784404993.229450:0:21332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784404993.229455:0:21332:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd5732b8380 x1871083729015936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784405011 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404993.229462:0:21332:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784404993.229465:0:21332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:0.0:1784404993.229653:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083729015936:0@lo:38:kworker.0 00000100:00080000:3.0:1784404993.232664:0:21332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784404993.232684:0:21332:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd574d34a80 x1871083729015424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404996 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404993.233011:0:21332:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd574d34e00 x1871083729015552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404997 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404993.233022:0:21332:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd570590a80 x1871083729015808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405001 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404993.233049:0:21332:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd5732bb100 x1871083729016064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405007 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404993.233063:0:21332:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd5732bb480 x1871083729016192/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784405002 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404993.233090:0:21332:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1784404993.233134:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083729016064:0@lo:400:kworker.0 00000100:00080000:3.0:1784404993.233168:0:21332:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1784404993.233174:0:21332:0:(import.c:65:import_set_state_nolock()) ffff9dd4433f8800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1784404993.233181:0:21332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784404993.233186:0:21332:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd574d34a80 x1871083729015424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404996 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784404993.235544:0:19706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784404993.235558:0:19706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a250 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404993.235570:0:19706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151be00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404993.235574:0:19706:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a250 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404993.235584:0:19706:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd7a250 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404993.235608:0:19706:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd7a250 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404993.235614:0:19706:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784404993.235617:0:19706:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784404993.235620:0:19706:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784404993.235641:0:19706:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd443e84800 00010000:00010000:1.0:1784404993.235645:0:19706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a249 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd7a250 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404993.235651:0:19706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd58151be00/0x24b3e2e6dcd7a249 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd7a250 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784404993.235943:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083729015808:0@lo:400:kworker.0 00000100:00100000:2.0:1784404993.236163:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083729015424:0@lo:400:kworker.0 00000100:00100000:3.0:1784404993.236219:0:21332:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd574d34e00 x1871083729015552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784404997 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404993.236242:0:21332:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd570590a80 x1871083729015808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405001 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404993.236250:0:21332:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd5732bb480 x1871083729016192/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784405002 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784404993.236257:0:21332:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00010000:00010000:1.0:1784404993.236651:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404993.236654:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404993.236656:0:19706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784404993.237041:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083729015552:0@lo:400:kworker.0 00000100:00100000:3.0:1784404993.237252:0:21332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1784404993.237286:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1871083729016192:0@lo:38:kworker.0 00010000:00010000:2.0:1784404993.243737:0:21332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6c00/0x24b3e2e6dcd7a21f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a226 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404993.243760:0:21332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6c00/0x24b3e2e6dcd7a21f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a226 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404993.243776:0:21332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6c00/0x24b3e2e6dcd7a21f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a226 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404993.243784:0:21332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6c00/0x24b3e2e6dcd7a21f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a226 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404993.243817:0:21332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784404993.243825:0:21332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442057400/0x24b3e2e6dcd7a402 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a409 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404993.243831:0:21332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442057400/0x24b3e2e6dcd7a402 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a409 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404993.243837:0:21332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442057400/0x24b3e2e6dcd7a402 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a409 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404993.243842:0:21332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.142@tcp lock: ffff9dd442057400/0x24b3e2e6dcd7a402 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x24b3e2e6dcd7a409 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784404993.244009:0:21332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1784404993.244030:0:21332:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1784404993.244066:0:21332:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1784404993.244071:0:21332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1784404993.244087:0:21332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404993.244093:0:21332:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784404993.244098:0:21332:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9dd573a8b380) has no exports 00000020:00080000:2.0:1784404993.244128:0:21332:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9dd573a8b380) has no exports 00000020:01000000:2.0:1784404993.252292:0:21332:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd441b23060 - data ffff9dd57fc12bd0/ffff9dd44359ac00 00000020:01000000:2.0:1784404993.252448:0:21332:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9dd441b238a0 - data ffff9dd5661585e8/ffff9dd443598000 00010000:00010000:1.0:1784404993.253114:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784404993.253126:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6c00/0x24b3e2e6dcd7a21f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a226 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404993.253140:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6c00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404993.253144:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6c00/0x24b3e2e6dcd7a21f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a226 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404993.253156:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6c00/0x24b3e2e6dcd7a21f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd7a226 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404993.253164:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6c00/0x24b3e2e6dcd7a21f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd7a226 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404993.253189:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784404993.253192:0:17142:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1784404993.253195:0:17142:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1784404993.253211:0:17142:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd443e84800 00010000:00010000:1.0:1784404993.253215:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6c00/0x24b3e2e6dcd7a21f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd7a226 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404993.253221:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6c00/0x24b3e2e6dcd7a21f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd7a226 expref: -99 pid: 19473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404993.253232:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784404993.253236:0:17142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd442057400/0x24b3e2e6dcd7a402 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a409 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404993.253242:0:17142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057400 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784404993.253245:0:17142:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd442057400/0x24b3e2e6dcd7a402 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x24b3e2e6dcd7a409 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404993.253251:0:17142:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd442057400/0x24b3e2e6dcd7a402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd7a409 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784404993.253256:0:17142:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd442057400/0x24b3e2e6dcd7a402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd7a409 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784404993.253261:0:17142:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1784404993.253263:0:17142:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1784404993.253265:0:17142:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1784404993.253269:0:17142:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd443e84800 00010000:00010000:1.0:1784404993.253271:0:17142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd442057400/0x24b3e2e6dcd7a402 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd7a409 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404993.253284:0:17142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd442057400/0x24b3e2e6dcd7a402 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd7a409 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784404993.253297:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404993.253299:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784404993.253301:0:17142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784404993.255022:0:17143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1784404993.267558:0:21332:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1784404993.284557:0:21332:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a234 00000020:00000080:0.0:1784404993.284588:0:21332:0:(genops.c:885:class_export_put()) final put ffff9dd441a2f000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1784404993.284623:0:21332:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd4435d4800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1784404993.284629:0:21332:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd4435d4800 2 00000020:01000004:0.0:1784404993.284634:0:21332:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dd4435d4800 from lustre-OST0001 00000020:00000080:1.0:1784404993.284652:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd441a2f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1784404993.284685:0:21332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784404993.284702:0:21332:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1784404993.284707:0:21332:0:(genops.c:885:class_export_put()) final put ffff9dd543075800/lustre-OST0001_UUID 00000020:00000080:0.0:1784404993.284711:0:21332:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd543075800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1784404993.284723:0:21332:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1784404993.285249:0:21332:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import fccb8c6c-dea6-48fe-a863-d61ae2c1427e->MGS 00010000:00010000:0.0:1784404993.285275:0:21332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd54516ee00/0x24b3e2e6dcd79f78 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd79f7f expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404993.285292:0:21332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd54516ee00/0x24b3e2e6dcd79f78 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd79f7f expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404993.285299:0:21332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1784404993.285303:0:21332:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1784404993.285307:0:21332:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1784404993.285329:0:21332:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd443e84800 00010000:00010000:0.0:1784404993.285333:0:21332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd54516ee00/0x24b3e2e6dcd79f78 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd79f7f expref: -99 pid: 17885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784404993.285369:0:21332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd54516e400/0x24b3e2e6dcd79e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x24b3e2e6dcd79e6e expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784404993.285376:0:21332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd54516e400/0x24b3e2e6dcd79e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x24b3e2e6dcd79e6e expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784404993.285381:0:21332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784404993.285383:0:21332:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1784404993.285385:0:21332:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1784404993.285405:0:21332:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dd443e84800 00010000:00010000:0.0:1784404993.285408:0:21332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd54516e400/0x24b3e2e6dcd79e67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x24b3e2e6dcd79e6e expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784404993.285513:0:21332:0:(import.c:65:import_set_state_nolock()) ffff9dd443e84800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1784404993.285518:0:21332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1784404993.285521:0:21332:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1784404993.285524:0:21332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1784404993.285530:0:21332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1784404993.285546:0:21332:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dd570593800 x1871083729015680/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1784405000 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1784404993.285575:0:21332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1784404993.285584:0:21332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:1.0:1784404993.285641:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fccb8c6c-dea6-48fe-a863-d61ae2c1427e:3645:1871083729015680:0@lo:250:kworker.0 10000000:01000000:0.0:1784404993.285695:0:21332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1784404993.285707:0:21332:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd79e52 00000020:00000080:0.0:1784404993.285715:0:21332:0:(genops.c:885:class_export_put()) final put ffff9dd443e81000/fccb8c6c-dea6-48fe-a863-d61ae2c1427e 00000020:01000000:0.0:1784404993.285734:0:21332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.142@tcp (flags='') 00000020:00000080:0.0:1784404993.285740:0:21332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784404993.285747:0:21332:0:(obd_config.c:955:class_cleanup()) MGC192.168.202.142@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784404993.285752:0:21332:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9dd573b199c0) has no exports 00000020:00000080:1.0:1784404993.285943:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443e81000/fccb8c6c-dea6-48fe-a863-d61ae2c1427e for MGC192.168.202.142@tcp 10000000:01000000:2.0:1784404993.286093:0:17151:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1784404993.286673:0:21332:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.142@tcp: client import never connected 00000100:00080000:1.0:1784404993.286678:0:21332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1784404993.286682:0:21332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1784404993.286686:0:21332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1784404993.286688:0:21332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1784404993.286760:0:21332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784404993.286770:0:21332:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.142@tcp (uuid fccb8c6c-dea6-48fe-a863-d61ae2c1427e) 00000020:01000000:1.0:1784404993.286778:0:21332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1784404993.286783:0:21332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784404993.286789:0:21332:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784404993.286795:0:21332:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9dd4433fb800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784404993.286800:0:21332:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9dd5445f99c0) has exports, disconnecting them 00000020:00080000:1.0:1784404993.286805:0:21332:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9dd4433fb800), last request at 1784404925 00000020:00000080:1.0:1784404993.286809:0:21332:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a25e 00000020:00080000:1.0:1784404993.286824:0:21332:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd4433fb800): rc 0 00000020:00000080:1.0:1784404993.286829:0:21332:0:(genops.c:885:class_export_put()) final put ffff9dd4433fb800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1784404993.288010:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd443e84800 for MGC192.168.202.142@tcp 00000020:00000080:0.0:1784404993.288029:0:8:0:(genops.c:885:class_export_put()) final put ffff9dd443e85800/fccb8c6c-dea6-48fe-a863-d61ae2c1427e 00000020:00000080:0.0:1784404993.288032:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443e85800/fccb8c6c-dea6-48fe-a863-d61ae2c1427e for MGC192.168.202.142@tcp 00000020:01000000:0.0:1784404993.288039:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.142@tcp (fccb8c6c-dea6-48fe-a863-d61ae2c1427e) 00000020:00000080:0.0:1784404993.288343:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd4433fb800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1784404993.288990:0:21332:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1784404993.288994:0:21332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784404993.288998:0:21332:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784404993.289004:0:21332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784404993.289156:0:21332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784404993.289165:0:21332:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1784404993.289172:0:21332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1784404993.289176:0:21332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784404993.289180:0:21332:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784404993.289186:0:21332:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9dd4433fc000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784404993.289193:0:21332:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9dd4430a19c0) has exports, disconnecting them 00000020:00080000:0.0:1784404993.289198:0:21332:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9dd4433fc000), last request at 1784404925 00000020:00000080:0.0:1784404993.289202:0:21332:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a273 00000020:00080000:0.0:1784404993.289217:0:21332:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dd4433fc000): rc 0 00000020:00000080:0.0:1784404993.289222:0:21332:0:(genops.c:885:class_export_put()) final put ffff9dd4433fc000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1784404993.290007:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd4433f8000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1784404993.290015:0:8:0:(genops.c:885:class_export_put()) final put ffff9dd5441d1000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1784404993.290019:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd5441d1000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1784404993.290030:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1784404993.290100:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd4433fc000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1784404993.304962:0:21332:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1784404993.304971:0:21332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784404993.304976:0:21332:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784404993.304983:0:21332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784404993.305016:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9dd4433f8800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1784404993.315227:0:19705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1784404993.315840:0:19706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1784404993.316183:0:17142:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1784404993.316429:0:17143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1784404993.317474:0:17138:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9dd54258c800:17138] 1 exiting: rc = 0 00000100:00100000:2.0:1784404993.317605:0:17137:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9dd442110200:17137] 0 exiting: rc = 1 00000100:00100000:2.0:1784404993.317668:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.318337:0:17140:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9dd44318ea00:17140] 1 exiting: rc = 0 00000100:00100000:1.0:1784404993.318404:0:17141:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9dd44318ec00:17141] 2 exiting: rc = 0 00000100:00100000:2.0:1784404993.318651:0:17139:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9dd44318f400:17139] 0 exiting: rc = 1 00000100:00100000:0.0:1784404993.318826:0:20728:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9dd444c73a00:20728] 3 exiting: rc = 0 00000100:00100000:2.0:1784404993.318987:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.318994:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319002:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319008:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319013:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319020:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319039:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319044:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319050:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319057:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319062:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319068:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319073:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319106:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319111:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319116:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319121:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319126:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319131:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319136:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319141:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319146:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319152:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319157:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319162:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319167:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319173:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319178:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319183:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319189:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319194:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319199:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319205:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319210:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319216:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319221:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319227:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319231:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319236:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319241:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319246:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319260:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319265:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319273:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319450:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319459:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319463:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319469:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319474:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319479:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319485:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319491:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319496:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319501:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319506:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319510:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319515:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319519:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319524:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319529:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319533:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319538:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319543:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.319548:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1784404993.321803:0:21332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784404993.321815:0:21332:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1784404993.321821:0:21332:0:(genops.c:885:class_export_put()) final put ffff9dd4433f9000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1784404993.321825:0:21332:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd4433f9000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1784404993.321831:0:21332:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1784404993.322040:0:21332:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd4435d4800 1 00000020:00000080:2.0:1784404993.322047:0:21332:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x24b3e2e6dcd7a218 00000020:00000080:2.0:1784404993.322052:0:21332:0:(genops.c:885:class_export_put()) final put ffff9dd573224800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1784404993.322070:0:21332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1784404993.322074:0:21332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784404993.322088:0:21332:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784404993.322101:0:21332:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9dd4421399c0) has no exports 00000020:00000080:0.0:1784404993.322601:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd573224800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1784404993.378196:0:21332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784404993.378215:0:21332:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1784404993.378221:0:21332:0:(genops.c:885:class_export_put()) final put ffff9dd4435d2000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1784404993.378226:0:21332:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd4435d2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1784404993.378238:0:21332:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1784404993.378641:0:21332:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dd4435d7800 00000020:01000000:0.0:1784404993.378666:0:21332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1784404993.378680:0:21332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784404993.378685:0:21332:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784404993.378690:0:21332:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9dd5445f8000) has no exports 00000020:00000080:0.0:1784404993.378711:0:21332:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784404993.383254:0:21332:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1784404993.383265:0:21332:0:(genops.c:885:class_export_put()) final put ffff9dd443cf0800/OSS_uuid 00000020:00000080:0.0:1784404993.383270:0:21332:0:(genops.c:844:class_export_destroy()) destroying export ffff9dd443cf0800/OSS_uuid for OSS 00000020:01000000:0.0:1784404993.383278:0:21332:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1784404993.384379:0:17150:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1784404993.384560:0:18662:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9dd573a61000:18662] 2 exiting: rc = 0 00000100:00100000:3.0:1784404993.384626:0:19139:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9dd44305f400:19139] 3 exiting: rc = 0 00000100:00100000:0.0:1784404993.385332:0:18660:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9dd442738800:18660] 0 exiting: rc = 1 00000100:00100000:2.0:1784404993.386159:0:19703:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9dd44309da00:19703] 4 exiting: rc = 0 00000100:00100000:2.0:1784404993.386242:0:18661:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9dd443460e00:18661] 1 exiting: rc = 0 00000100:00100000:0.0:1784404993.386406:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386417:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386423:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386429:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386444:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386451:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386456:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386462:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386468:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386474:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386480:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386485:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386491:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386497:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386502:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386507:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386513:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386518:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386524:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386529:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386535:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386542:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386547:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386551:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386556:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386561:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386580:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386585:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386590:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386595:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386600:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386605:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386610:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386614:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386619:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386623:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386628:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386634:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386638:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386643:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386648:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386654:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386659:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386664:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386670:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386675:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386680:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386684:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386689:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386694:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386700:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386706:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386712:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386731:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386737:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386742:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386749:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386754:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386764:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386769:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386776:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386789:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386795:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.386800:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.388330:0:19617:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9dd442240000:19617] 2 exiting: rc = 0 00000100:00100000:2.0:1784404993.388422:0:18664:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9dd57b4ce600:18664] 1 exiting: rc = 0 00000100:00100000:0.0:1784404993.392087:0:18663:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9dd545ba5600:18663] 0 exiting: rc = 1 00000100:00100000:2.0:1784404993.392275:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392284:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392290:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392295:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392301:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392306:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392312:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392318:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392323:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392329:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392333:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392339:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392344:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392349:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392354:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392360:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392365:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392370:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392375:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392381:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392385:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392390:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392396:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392400:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392405:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392410:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392416:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392421:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392425:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392516:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392521:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392526:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392531:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392537:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392542:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392547:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392552:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392558:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392564:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392569:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392575:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392580:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392585:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392589:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392596:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392601:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392606:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392612:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392617:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392623:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392628:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392634:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392639:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392644:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392649:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392655:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392660:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392665:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392670:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392675:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392680:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392685:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392690:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.392695:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.402989:0:20296:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9dd573257c00:20296] 3 exiting: rc = 0 00000100:00100000:2.0:1784404993.403272:0:18667:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9dd4435bf800:18667] 2 exiting: rc = 0 00000100:00100000:0.0:1784404993.403754:0:18665:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9dd5443c4c00:18665] 0 exiting: rc = 1 00000100:00100000:3.0:1784404993.403986:0:18666:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9dd4435be000:18666] 1 exiting: rc = 0 00000100:00100000:2.0:1784404993.404226:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404234:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404240:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404246:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404259:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404265:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404270:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404276:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404281:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404287:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404293:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404298:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404304:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404346:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404354:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404359:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404365:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404370:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404375:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404381:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404387:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404393:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404399:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404404:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404410:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404415:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404420:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404426:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404433:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404440:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404445:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404452:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404458:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404481:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404487:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404494:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404500:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404520:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404528:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404534:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404539:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404544:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404550:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404556:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404563:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404569:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404574:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404581:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404587:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404593:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404598:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404604:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404610:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404618:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404623:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404640:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404647:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404652:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404657:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404662:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404668:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404673:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404678:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.404684:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.414378:0:18668:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9dd4435be400:18668] 0 exiting: rc = 1 00000100:00100000:0.0:1784404993.414409:0:18669:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9dd5443c5a00:18669] 1 exiting: rc = 0 00000100:00100000:2.0:1784404993.414994:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415002:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415008:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415014:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415034:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415040:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415052:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415059:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415064:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415070:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415087:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415094:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415099:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415104:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415110:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415116:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415122:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415127:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415133:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415139:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415145:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415150:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415156:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415162:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415167:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415173:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415178:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415183:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415189:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415194:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415199:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415205:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415210:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415215:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415221:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415226:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415232:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415236:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415241:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415254:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415259:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415264:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415270:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415275:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415281:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415286:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415290:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415295:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415299:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415304:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415310:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415596:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415603:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415608:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415613:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415618:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415623:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415628:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415632:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415637:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415641:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415646:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415650:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784404993.415655:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784404993.421522:0:18671:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9dd56d46b000:18671] 1 exiting: rc = 0 00000100:00100000:1.0:1784404993.421963:0:18670:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9dd56d46b400:18670] 0 exiting: rc = 1 00000100:00100000:1.0:1784404993.424966:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.424978:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.424984:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.424990:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425018:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425024:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425029:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425035:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425041:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425047:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425053:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425060:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425066:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425072:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425088:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425094:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425230:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425238:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425244:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425250:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425257:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425262:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425268:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425274:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425280:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425287:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425294:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425312:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425331:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425338:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425344:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425350:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425357:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425364:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425370:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425377:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425385:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425391:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425400:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425408:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425430:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425439:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425446:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425453:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425459:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425465:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425471:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425480:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425486:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425491:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425497:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425526:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425549:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425556:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425564:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425569:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425575:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425582:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425589:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425596:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425603:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425612:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425625:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784404993.425631:0:21332:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1784404993.442441:0:21332:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1784405015.586097:0:22096:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1784405026.652997:0:22695:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784405026.653005:0:22695:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1784405026.653006:0:22695:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1784405026.653119:0:22695:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9dd442282800 00000020:01000004:2.0:1784405026.653136:0:22695:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1784405026.653143:0:22695:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784405026.653158:0:22695:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9dd4430a19c0) 00000020:00000080:2.0:1784405026.653173:0:22695:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784405026.737841:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1784405026.739374:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1784405026.740012:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1784405026.742329:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1784405026.742572:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1784405026.742934:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1784405026.743167:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1784405026.743404:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1784405026.743646:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1784405026.744318:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1784405026.744563:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1784405026.744914:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1784405026.745139:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1784405026.745374:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1784405026.745608:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1784405026.746058:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1784405026.746288:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1784405026.746512:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1784405026.747217:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1784405026.747552:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1784405026.747935:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1784405026.748307:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1784405026.748576:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1784405026.749007:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1784405026.749264:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1784405026.752582:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1784405026.753540:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1784405026.754146:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1784405026.754386:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1784405026.754828:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1784405026.758620:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1784405026.759203:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1784405026.759424:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1784405026.760081:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1784405026.760283:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1784405026.761134:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1784405026.761630:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1784405026.762437:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1784405026.763401:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1784405026.763795:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1784405026.764203:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1784405026.764423:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1784405026.764811:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1784405026.765122:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1784405026.765375:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1784405026.765582:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1784405026.767950:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1784405026.772004:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1784405026.772800:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1784405026.773316:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1784405026.774050:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1784405026.774318:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1784405026.774559:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:3.0:1784405026.776337:0:22695:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784405026.776607:0:22695:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784405026.776616:0:22695:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784405026.776629:0:22695:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd7a6be 00000020:01000004:3.0:1784405026.776637:0:22695:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1784405026.776643:0:22695:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784405026.776650:0:22695:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd442282800 from MGS 00000020:01000004:3.0:1784405026.776653:0:22695:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784405026.776664:0:22695:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9dd573b04d40) 00000020:00000080:3.0:1784405026.776675:0:22695:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1784405026.776743:0:22695:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd442282800 from MGS, refs=2 00080000:01000000:3.0:1784405026.776748:0:22695:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784405026.776753:0:22695:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd7a6cc 00000100:00100000:3.0:1784405026.776923:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1784405026.777057:0:22695:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1784405026.777064:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1784405026.780160:0:22695:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1784405026.780174:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1784405026.781778:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784405026.782613:0:22695:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1784405026.782620:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1784405026.783621:0:22695:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1784405026.783629:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1784405026.785368:0:22695:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1784405026.785383:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1784405026.787225:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405026.787230:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405026.787232:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405026.788023:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405026.788026:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405026.788028:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405026.789254:0:22695:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1784405026.796386:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1784405026.799800:0:22695:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1784405026.801906:0:22708:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1784405026.801991:0:22695:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1784405026.802052:0:22695:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784405026.804611:0:22695:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784405026.805289:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784405026.805454:0:22695:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1784405026.805461:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1784405026.810120:0:22695:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1784405026.810136:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1784405026.814110:0:22695:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1784405026.814124:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1784405026.814791:0:22695:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1784405026.814816:0:22695:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.142@tcp' 00000020:01000004:1.0:1784405026.814819:0:22695:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1784405026.815013:0:22695:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.142@tcp (typ=mgc) 00000020:00000080:1.0:1784405026.815028:0:22695:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.142@tcp (ffff9dd44213b380) 00000020:00000080:1.0:1784405026.815048:0:22695:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1784405026.815131:0:22695:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd444d8f800@MGC192.168.202.142@tcp: add connection 192.168.202.142@tcp at head 00010000:00010000:1.0:1784405026.815290:0:22695:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.142@tcp-0 is initialized 00000040:01000000:1.0:1784405026.815297:0:22695:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 1 is initialized 00000100:00080000:3.0:1784405026.815562:0:22713:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1784405026.815762:0:22714:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1784405026.815844:0:22695:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.142@tcp (uuid 446d3b01-f4c0-4b8c-bf87-7caa910a24b3) 00000020:00000080:3.0:1784405026.815907:0:22695:0:(genops.c:1385:class_connect()) connect: client 446d3b01-f4c0-4b8c-bf87-7caa910a24b3, cookie 0x24b3e2e6dcd7a6da 00000100:00080000:3.0:1784405026.815918:0:22695:0:(import.c:510:import_select_connection()) MGC192.168.202.142@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784405026.815931:0:22695:0:(import.c:624:import_select_connection()) MGC192.168.202.142@tcp: import ffff9dd444d8f800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784405026.815963:0:22695:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd573b9b800 x1871083729016320/t0(0) o250->MGC192.168.202.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784405026.815987:0:22695:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 446d3b01-f4c0-4b8c-bf87-7caa910a24b3->MGS 00000020:01000004:3.0:1784405026.816003:0:22695:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1784405026.816008:0:22695:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1784405026.816020:0:22695:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9dd573b03380) 00000020:00000080:3.0:1784405026.816029:0:22695:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1784405026.816162:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3645:1871083729016320:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1784405026.816218:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405026.816440:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729016320 00000100:00100000:2.0:1784405026.816446:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729016320 00000100:00100000:2.0:1784405026.816474:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784405026.816481:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3645:x1871083729016320:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1784405026.816502:0:22711:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 446d3b01-f4c0-4b8c-bf87-7caa910a24b3@0@lo t0 exp 0000000000000000 cur 644 last 0 00000020:00000080:2.0:1784405026.816524:0:22711:0:(genops.c:1385:class_connect()) connect: client 446d3b01-f4c0-4b8c-bf87-7caa910a24b3, cookie 0x24b3e2e6dcd7a6e8 00000100:00080000:2.0:1784405026.816634:0:22711:0:(import.c:65:import_set_state_nolock()) ffff9dd558f24800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784405026.816688:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+5:3645:x1871083729016320:12345-0@lo:250:mount.lustre.0 Request processed in 205us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405026.816695:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784405026.817187:0:3645:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.142@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1784405026.817197:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.142@tcp: connect to target with instance 0 00000100:00080000:1.0:1784405026.817204:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.142@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1784405026.817208:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1784405026.817212:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd444d8f800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1784405026.817214:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1784405026.817220:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1784405026.817225:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3645:1871083729016320:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1784405026.826927:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784405026.827117:0:22695:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1784405026.827124:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1784405026.833970:0:22695:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1784405026.833984:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1784405026.834444:0:22695:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1784405026.834451:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1784405026.835288:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784405026.835465:0:22695:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1784405026.835477:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1784405026.838124:0:22695:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1784405026.838138:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1784405026.895746:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784405026.896140:0:22695:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1784405026.896148:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1784405026.899528:0:22695:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1784405026.899542:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1784405026.900264:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784405026.900457:0:22695:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1784405026.900462:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1784405026.901095:0:22695:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784405026.901104:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1784405026.902230:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784405026.902411:0:22695:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784405026.902416:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1784405026.903631:0:22695:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784405026.903639:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1784405026.904596:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784405026.904985:0:22695:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784405026.904991:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1784405026.905573:0:22695:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784405026.905580:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1784405026.925140:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784405026.925347:0:22695:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1784405026.925354:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1784405026.929279:0:22695:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784405026.929299:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1784405026.930847:0:22695:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1784405026.931362:0:22695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1784405026.932524:0:22695:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1784405026.932557:0:22695:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1784405026.932564:0:22695:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1784405026.932771:0:22695:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784405026.932825:0:22695:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.142@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1784405026.932830:0:22695:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784405026.932832:0:22695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784405026.932833:0:22695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784405026.932834:0:22695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784405026.932836:0:22695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784405026.932842:0:22695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784405026.932843:0:22695:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784405026.932845:0:22695:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784405026.932846:0:22695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784405026.932847:0:22695:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784405026.933042:0:22695:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1784405026.933045:0:22695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784405026.933047:0:22695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784405026.933048:0:22695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784405026.933049:0:22695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784405026.933050:0:22695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784405026.933051:0:22695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784405026.933052:0:22695:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784405026.933052:0:22695:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784405026.933053:0:22695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784405026.933054:0:22695:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784405026.933084:0:22695:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784405026.933108:0:22695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729016448:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784405026.933271:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405026.933370:0:22695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd546c4d300 going to sleep for 11 seconds 00000100:00100000:3.0:1784405026.933571:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729016448 00000100:00100000:3.0:1784405026.933580:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729016448 00000100:00100000:3.0:1784405026.933680:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784405026.933691:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+5:22695:x1871083729016448:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784405026.933754:0:22712:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784405026.933757:0:22712:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784405026.933760:0:22712:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1784405026.934446:0:22733:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1784405026.935900:0:22712:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1784405026.939528:0:22734:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1784405026.939539:0:22734:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1784405026.939542:0:22734:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1784405026.939545:0:22734:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1784405026.939775:0:22734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1784405026.940091:0:22712:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784405026.940106:0:22712:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1784405026.947228:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+5:22695:x1871083729016448:12345-0@lo:253:mount.lustre.0 Request processed in 13527us (13946us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405026.947244:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784405026.947346:0:22695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729016448:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784405026.947362:0:22695:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784405026.947366:0:22695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784405026.947368:0:22695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784405026.947369:0:22695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784405026.947370:0:22695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784405026.947371:0:22695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784405026.947373:0:22695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784405026.947374:0:22695:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784405026.947376:0:22695:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784405026.947378:0:22695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784405026.947391:0:22695:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784405026.947409:0:22695:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd442282800 from lustre-MDT0000 10000000:01000000:0.0:1784405026.947657:0:22695:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1784405026.947660:0:22695:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784405026.947739:0:22695:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9dd44213b380 10000000:01000000:0.0:1784405026.947746:0:22695:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784405026.947756:0:22695:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9dd44213b380 from 1 10000000:01000000:0.0:1784405026.947760:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784405026.947817:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd7a6ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405026.947829:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd7a6ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405026.947839:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd7a6ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405026.947939:0:22695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729016576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784405026.947984:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405026.948081:0:22695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd546c4d600 going to sleep for 11 seconds 00000100:00100000:2.0:1784405026.948119:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729016576 00000100:00100000:2.0:1784405026.948125:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729016576 00000100:00100000:2.0:1784405026.948279:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784405026.948290:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+5:22695:x1871083729016576:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784405026.948304:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784405026.948319:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd4425c7000/0x24b3e2e6dcd7a6f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a6ef expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405026.948343:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd4425c7000/0x24b3e2e6dcd7a6f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a6ef expref: 6 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405026.948353:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd4425c7000/0x24b3e2e6dcd7a6f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a6ef expref: 6 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405026.948362:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7000, rc 0) 00000100:00100000:2.0:1784405026.948409:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+6:22695:x1871083729016576:12345-0@lo:101:mount.lustre.0 Request processed in 121us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405026.948415:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784405026.948488:0:22695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729016576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784405026.948503:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd7a6ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a6f6 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405026.948510:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd7a6ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a6f6 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405026.948564:0:22695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729016704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784405026.948590:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405026.948802:0:22695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd546c4d600 going to sleep for 11 seconds 00000100:00100000:3.0:1784405026.948916:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729016704 00000100:00100000:3.0:1784405026.948921:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729016704 00000100:00100000:3.0:1784405026.948945:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784405026.948953:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+6:22695:x1871083729016704:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784405026.949034:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+6:22695:x1871083729016704:12345-0@lo:501:mount.lustre.0 Request processed in 82us (443us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784405026.949040:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784405026.949126:0:22695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729016704:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1784405026.949167:0:22695:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784405026.949185:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd7a6ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a6f6 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405026.949195:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd7a6ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a6f6 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784405026.949203:0:22695:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd442282800 10000000:01000000:0.0:1784405026.949208:0:22695:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784405026.949212:0:22695:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dd442282800 10000000:01000000:0.0:1784405026.949215:0:22695:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1784405026.949219:0:22695:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9dd442282800 from 1 10000000:01000000:0.0:1784405026.949221:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784405026.949242:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd7a6fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405026.949250:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd7a6fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405026.949257:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd7a6fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405026.949271:0:22695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729016832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784405026.949296:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405026.949322:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729016832 00000100:00100000:0.0:1784405026.949326:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729016832 00000100:00100000:0.0:1784405026.949343:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784405026.949349:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+6:22695:x1871083729016832:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784405026.949366:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405026.949376:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443548e00/0x24b3e2e6dcd7a704 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a6fd expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405026.949391:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443548e00/0x24b3e2e6dcd7a704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a6fd expref: 7 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405026.949399:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443548e00/0x24b3e2e6dcd7a704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a6fd expref: 7 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405026.949406:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443548e00, rc 0) 00000100:00100000:0.0:1784405026.949431:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+7:22695:x1871083729016832:12345-0@lo:101:mount.lustre.0 Request processed in 82us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405026.949437:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784405026.949482:0:22695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd546c4d600 going to sleep for 11 seconds 00000100:00100000:0.0:1784405026.949496:0:22695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729016832:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784405026.949506:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd7a6fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a704 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405026.949513:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd7a6fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a704 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784405026.949525:0:22695:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784405026.949529:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd7a6fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a704 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405026.949535:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd443549200/0x24b3e2e6dcd7a6fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a704 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784405026.949552:0:22695:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784405026.949555:0:22695:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784405026.949560:0:22695:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dd442282800 10000000:01000000:0.0:1784405026.949562:0:22695:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1784405026.949564:0:22695:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1784405026.949566:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784405026.949579:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548c00/0x24b3e2e6dcd7a70b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405026.949586:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd443548c00/0x24b3e2e6dcd7a70b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405026.949592:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd443548c00/0x24b3e2e6dcd7a70b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405026.949604:0:22695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729016960:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784405026.949628:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405026.949647:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729016960 00000100:00100000:0.0:1784405026.949650:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729016960 00000100:00100000:0.0:1784405026.949677:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784405026.949683:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+7:22695:x1871083729016960:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784405026.949689:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405026.949696:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443549800/0x24b3e2e6dcd7a712 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a70b expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405026.949708:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443549800/0x24b3e2e6dcd7a712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a70b expref: 8 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405026.949726:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443549800/0x24b3e2e6dcd7a712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a70b expref: 8 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405026.949733:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549800, rc 0) 00000100:00100000:0.0:1784405026.949754:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+8:22695:x1871083729016960:12345-0@lo:101:mount.lustre.0 Request processed in 71us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405026.949759:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784405026.949779:0:22695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd546c4d600 going to sleep for 11 seconds 00000100:00100000:0.0:1784405026.949801:0:22695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729016960:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784405026.949810:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd443548c00/0x24b3e2e6dcd7a70b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a712 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405026.949818:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd443548c00/0x24b3e2e6dcd7a70b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a712 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405026.949897:0:22695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729017088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784405026.949922:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405026.949940:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729017088 00000100:00100000:0.0:1784405026.949943:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729017088 00000100:00100000:0.0:1784405026.949959:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784405026.949964:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+8:22695:x1871083729017088:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784405026.950074:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+9:22695:x1871083729017088:12345-0@lo:501:mount.lustre.0 Request processed in 108us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405026.950080:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784405026.950107:0:22695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd546c4d600 going to sleep for 11 seconds 00000100:00100000:0.0:1784405026.950119:0:22695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729017088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784405026.950152:0:22695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729017216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784405026.950189:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405026.950208:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729017216 00000100:00100000:0.0:1784405026.950212:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729017216 00000100:00100000:0.0:1784405026.950227:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784405026.950232:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+9:22695:x1871083729017216:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784405026.950379:0:22695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545bdf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784405026.951323:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+9:22695:x1871083729017216:12345-0@lo:503:mount.lustre.0 Request processed in 1086us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405026.951331:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784405026.951391:0:22695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729017216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784405026.952589:0:22735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22735:1871083729017344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784405026.952834:0:22735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405026.952898:0:22735:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd550a54300 going to sleep for 11 seconds 00000100:00100000:0.0:1784405026.952994:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729017344 00000100:00100000:0.0:1784405026.953000:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729017344 00000100:00100000:0.0:1784405026.953046:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784405026.953054:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+9:22735:x1871083729017344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784405026.954084:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+9:22735:x1871083729017344:12345-0@lo:502:llog_process_th.0 Request processed in 1026us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405026.954094:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784405026.954278:0:22735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22735:1871083729017344:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784405026.954309:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784405026.954321:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405026.954323:0:22735:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784405026.954328:0:22735:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1784405026.954331:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784405026.954345:0:22735:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9dd573b019c0) 00000020:00000080:3.0:1784405026.954363:0:22735:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1784405026.954369:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1784405026.954464:0:22735:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:3.0:1784405026.954533:0:22735:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd7a720 00000020:00000080:3.0:1784405026.954927:0:22735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784405026.954933:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784405026.954937:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405026.954939:0:22735:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784405026.954941:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784405026.954952:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405026.954953:0:22735:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1784405026.954958:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784405026.954967:0:22735:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9dd573b00000) 00000020:00000080:3.0:1784405026.954978:0:22735:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1784405026.954982:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1784405026.954984:0:22735:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1784405026.954988:0:22735:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1784405026.954993:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784405026.955038:0:22735:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd442282800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1784405026.955052:0:22735:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9dd56cb74d40) 00000020:00000080:3.0:1784405026.955060:0:22735:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1784405026.955114:0:22735:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1784405026.955120:0:22735:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd7a735 00000020:00000080:3.0:1784405026.955213:0:22735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1784405026.955219:0:22735:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1784405026.955224:0:22735:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x24b3e2e6dcd7a73c 00080000:01000000:3.0:1784405026.955228:0:22735:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784405026.955232:0:22735:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd7a743 00010000:00010000:2.0:1784405027.026644:0:22735:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1784405027.027199:0:22735:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1784405027.027531:0:22735:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784405027.028126:0:22735:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9dd4430a3380) 00000020:00000080:2.0:1784405027.028144:0:22735:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1784405027.028229:0:22735:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784405027.028236:0:22735:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd7a751 00000020:00000080:3.0:1784405027.028906:0:22735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784405027.031427:0:22735:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x24b3e2e6dcd7a758 00000020:00000080:1.0:1784405027.032077:0:22735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1784405027.032090:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784405027.032097:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405027.032100:0:22735:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1784405027.032103:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784405027.032106:0:22735:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1784405027.032107:0:22735:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784405027.032109:0:22735:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784405027.032110:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784405027.032113:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405027.032115:0:22735:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784405027.032117:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784405027.032121:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405027.032123:0:22735:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1784405027.032127:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1784405027.032171:0:22735:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1784405027.032194:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784405027.032198:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405027.032200:0:22735:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1784405027.032202:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784405027.032205:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405027.032206:0:22735:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1784405027.032209:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784405027.032214:0:22735:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:00000080:1.0:1784405027.032243:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784405027.032258:0:22735:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9dd44213cd40) 00000020:00000080:1.0:1784405027.032273:0:22735:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1784405027.032286:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784405027.032343:0:22735:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1784405027.032348:0:22735:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784405027.032354:0:22735:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd7a766 00010000:00080000:1.0:1784405027.032385:0:22735:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd548764800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:1.0:1784405027.034092:0:22735:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1784405027.042656:0:22735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784405027.042795:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1784405027.042888:0:22735:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784405027.042914:0:22735:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd7a76d 00000100:00080000:1.0:1784405027.042924:0:22735:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784405027.042930:0:22735:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd548764800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784405027.042965:0:22735:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd574d37480 x1871083729017472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784405027.042995:0:22735:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1784405027.043053:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784405027.043057:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405027.043059:0:22735:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1784405027.043061:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784405027.043063:0:22735:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1784405027.043065:0:22735:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784405027.043067:0:22735:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784405027.043068:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784405027.043071:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405027.043072:0:22735:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784405027.043074:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784405027.043079:0:22735:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1784405027.043082:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405027.043084:0:22735:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784405027.043087:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784405027.043090:0:22735:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:01000000:1.0:1784405027.043124:0:22735:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784405027.043126:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784405027.043138:0:22735:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9dd4421399c0) 00000020:00000080:1.0:1784405027.043150:0:22735:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1784405027.043155:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784405027.043209:0:22735:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1784405027.043215:0:22735:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:1.0:1784405027.043221:0:22735:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd7a77b 00010000:00080000:1.0:1784405027.043252:0:22735:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd57329b000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:1.0:1784405027.043440:0:22735:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1784405027.044293:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729017472:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784405027.044365:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405027.044439:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729017472 00000100:00100000:0.0:1784405027.044447:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729017472 00000100:00100000:0.0:1784405027.044548:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784405027.044556:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1871083729017472:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1784405027.044573:0:22722:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1784405027.044819:0:22735:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784405027.045622:0:22735:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1784405027.058997:0:22735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784405027.059258:0:22735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1784405027.067370:0:22735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1784405027.070948:0:22741:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1784405027.070958:0:22741:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1784405027.073179:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1871083729017472:12345-0@lo:38:llog_process_th.0 Request processed in 28612us (28805us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784405027.073198:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1784405027.073360:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd548764800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784405027.073367:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784405027.073371:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729017472:0@lo:38:llog_process_th.0 00000020:00000080:0.0:1784405027.074711:0:22735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784405027.074726:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784405027.074772:0:22735:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784405027.074805:0:22735:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd7a782 00000100:00080000:0.0:1784405027.074814:0:22735:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784405027.074820:0:22735:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dd57329b000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784405027.074876:0:22735:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd570590000 x1871083729017600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784405027.074903:0:22735:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784405027.074972:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784405027.074976:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784405027.074978:0:22735:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784405027.074981:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784405027.074984:0:22735:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1784405027.074986:0:22735:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784405027.074987:0:22735:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784405027.074989:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784405027.074991:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784405027.074992:0:22735:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784405027.074995:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784405027.074999:0:22735:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1784405027.075002:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784405027.075003:0:22735:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784405027.075006:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784405027.075010:0:22735:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:01000000:0.0:1784405027.075037:0:22735:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784405027.075046:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784405027.075059:0:22735:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9dd573a8b380) 00000020:00000080:0.0:1784405027.075072:0:22735:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1784405027.075079:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784405027.075139:0:22735:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1784405027.075145:0:22735:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:0.0:1784405027.075151:0:22735:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x24b3e2e6dcd7a790 00010000:00080000:0.0:1784405027.075181:0:22735:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd443585000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:0.0:1784405027.075382:0:22735:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1784405027.075452:0:22735:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784405027.075467:0:22735:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1784405027.075761:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729017600:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1784405027.075838:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083729017600 offset 0 length 520: 4 00000040:00080000:0.0:1784405027.078271:0:22735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784405027.078519:0:22735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1784405027.078794:0:22735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1784405027.080817:0:22743:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1784405027.080825:0:22743:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1784405027.081737:0:22735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784405027.081752:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784405027.081805:0:22735:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784405027.081827:0:22735:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd7a797 00000100:00080000:0.0:1784405027.081838:0:22735:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784405027.081845:0:22735:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd443585000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784405027.082414:0:22735:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd570592680 x1871083729017728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784405027.082506:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729017728:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1784405027.082561:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083729017728 offset 0 length 520: 4 00000100:00080000:0.0:1784405027.082746:0:22735:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1784405027.082829:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784405027.082834:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784405027.082836:0:22735:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784405027.082839:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784405027.082842:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784405027.082844:0:22735:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784405027.082846:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784405027.082870:0:22735:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784405027.082885:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784405027.082888:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784405027.082890:0:22735:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784405027.082892:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784405027.082895:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784405027.082897:0:22735:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784405027.082901:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784405027.082933:0:22735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22735:1871083729017856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784405027.082984:0:22735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405027.083016:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729017856 00000100:00100000:0.0:1784405027.083023:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729017856 00000100:00100000:0.0:1784405027.083072:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784405027.083083:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+9:22735:x1871083729017856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784405027.083210:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+9:22735:x1871083729017856:12345-0@lo:502:llog_process_th.0 Request processed in 128us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405027.083218:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784405027.083262:0:22735:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd553c53b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784405027.083283:0:22735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22735:1871083729017856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784405027.083308:0:22735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784405027.083312:0:22735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784405027.083313:0:22735:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784405027.083316:0:22735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1784405027.083371:0:22695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1784405027.083393:0:22695:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784405027.083409:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548c00/0x24b3e2e6dcd7a70b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a712 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.083419:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd443548c00/0x24b3e2e6dcd7a70b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a712 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784405027.083436:0:22695:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd442282800 from 1 10000000:01000000:0.0:1784405027.083439:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784405027.083487:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a79e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.083496:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a79e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.083505:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a79e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405027.083519:0:22695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729017984:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784405027.083547:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405027.083565:0:22695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd553c53b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784405027.084034:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729017984 00000100:00100000:0.0:1784405027.084040:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729017984 00000100:00100000:0.0:1784405027.084080:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784405027.084088:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+9:22695:x1871083729017984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784405027.084098:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405027.084112:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd7a7a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a79e expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.084136:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd7a7a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a79e expref: 10 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.084146:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd7a7a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a79e expref: 10 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.084168:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549400, rc 0) 00000100:00100000:0.0:1784405027.084214:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+10:22695:x1871083729017984:12345-0@lo:101:mount.lustre.0 Request processed in 127us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405027.084220:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784405027.084291:0:22695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729017984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784405027.084305:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a79e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a7a5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405027.084314:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a79e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a7a5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405027.084965:0:22695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729018112:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1784405027.085063:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405027.085094:0:22695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4427d1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784405027.085224:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729018112 00000100:00100000:2.0:1784405027.085230:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729018112 00000100:00100000:2.0:1784405027.085264:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784405027.085271:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+10:22695:x1871083729018112:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1784405027.085289:0:22711:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784405027.085296:0:22711:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1784405027.085377:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+10:22695:x1871083729018112:12345-0@lo:256:mount.lustre.0 Request processed in 104us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405027.085384:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784405027.085507:0:22695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729018112:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1784405027.086236:0:22695:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784405027.086295:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a79e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a7a5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405027.086306:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a79e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a7a5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784405027.086313:0:22695:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd442282800 from 1 10000000:01000000:3.0:1784405027.086317:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784405027.086349:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442057e00/0x24b3e2e6dcd7a7ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405027.086357:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd442057e00/0x24b3e2e6dcd7a7ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405027.086366:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd442057e00/0x24b3e2e6dcd7a7ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405027.086383:0:22695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729018240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784405027.086422:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405027.086452:0:22695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4427d1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784405027.086531:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729018240 00000100:00100000:2.0:1784405027.086538:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729018240 00000100:00100000:2.0:1784405027.086573:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784405027.086580:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+10:22695:x1871083729018240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784405027.086592:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784405027.086605:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd4425c7400/0x24b3e2e6dcd7a7b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a7ac expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405027.086625:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd4425c7400/0x24b3e2e6dcd7a7b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a7ac expref: 11 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405027.086635:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd4425c7400/0x24b3e2e6dcd7a7b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a7ac expref: 11 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405027.086644:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7400, rc 0) 00000100:00100000:2.0:1784405027.086694:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+11:22695:x1871083729018240:12345-0@lo:101:mount.lustre.0 Request processed in 114us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405027.086710:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784405027.086935:0:22695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729018240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784405027.086947:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd442057e00/0x24b3e2e6dcd7a7ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a7b3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405027.086966:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd442057e00/0x24b3e2e6dcd7a7ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a7b3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405027.087033:0:22695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729018368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784405027.087060:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405027.087079:0:22695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4427d1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784405027.087439:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729018368 00000100:00100000:1.0:1784405027.087445:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729018368 00000100:00100000:1.0:1784405027.087490:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784405027.087500:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+11:22695:x1871083729018368:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784405027.087761:0:22695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729018368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784405027.087809:0:22695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729018496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784405027.087893:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405027.087909:0:22695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4427d1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784405027.087983:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729018496 00000100:00100000:2.0:1784405027.087988:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729018496 00000100:00100000:2.0:1784405027.088008:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784405027.088015:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:22695:x1871083729018496:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784405027.088091:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:22695:x1871083729018496:12345-0@lo:503:mount.lustre.0 Request processed in 76us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405027.088098:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784405027.088182:0:22695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729018496:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784405027.088322:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+11:22695:x1871083729018368:12345-0@lo:501:mount.lustre.0 Request processed in 823us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405027.088329:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784405027.088770:0:22745:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22745:1871083729018624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784405027.088826:0:22745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405027.088879:0:22745:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4427d1300 going to sleep for 11 seconds 00000100:00100000:2.0:1784405027.088947:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729018624 00000100:00100000:2.0:1784405027.088954:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729018624 00000100:00100000:2.0:1784405027.088981:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784405027.088989:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+11:22745:x1871083729018624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784405027.089900:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+11:22745:x1871083729018624:12345-0@lo:502:llog_process_th.0 Request processed in 908us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405027.089909:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784405027.090096:0:22745:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22745:1871083729018624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784405027.090124:0:22745:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784405027.090134:0:22745:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405027.090137:0:22745:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784405027.090143:0:22745:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd442282800 00000020:00000080:3.0:1784405027.090146:0:22745:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784405027.090153:0:22745:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784405027.090155:0:22745:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405027.090156:0:22745:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784405027.090159:0:22745:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784405027.090161:0:22745:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405027.090169:0:22745:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784405027.090173:0:22745:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd442282800 00000020:00000080:3.0:1784405027.090176:0:22745:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784405027.090233:0:22745:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784405027.090237:0:22745:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405027.090238:0:22745:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1784405027.090240:0:22745:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784405027.090243:0:22745:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405027.090244:0:22745:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784405027.090248:0:22745:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd442282800 00000020:00000080:3.0:1784405027.090250:0:22745:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784405027.090271:0:22745:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784405027.090274:0:22745:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405027.090276:0:22745:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784405027.090278:0:22745:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784405027.090280:0:22745:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405027.090281:0:22745:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1784405027.090284:0:22745:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd442282800 00000020:00000080:3.0:1784405027.090286:0:22745:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784405027.090329:0:22745:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22745:1871083729018752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784405027.090368:0:22745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405027.090393:0:22745:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4427d1300 going to sleep for 11 seconds 00000100:00100000:1.0:1784405027.090463:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729018752 00000100:00100000:1.0:1784405027.090485:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729018752 00000100:00100000:1.0:1784405027.090524:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784405027.090531:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+11:22745:x1871083729018752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784405027.090620:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+11:22745:x1871083729018752:12345-0@lo:502:llog_process_th.0 Request processed in 89us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405027.090627:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784405027.091595:0:22745:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22745:1871083729018752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784405027.091628:0:22745:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784405027.091636:0:22745:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405027.091638:0:22745:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1784405027.091641:0:22745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1784405027.094814:0:22695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1784405027.094887:0:22695:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784405027.094906:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442057e00/0x24b3e2e6dcd7a7ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a7b3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405027.094940:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd442057e00/0x24b3e2e6dcd7a7ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a7b3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784405027.095001:0:22695:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784405027.095004:0:22695:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd442282800 10000000:01000000:3.0:1784405027.095007:0:22695:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd442282800 10000000:01000000:3.0:1784405027.095011:0:22695:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784405027.095017:0:22695:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd442282800 from 1 10000000:01000000:3.0:1784405027.095020:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784405027.095064:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442057a00/0x24b3e2e6dcd7a7ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405027.095072:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd442057a00/0x24b3e2e6dcd7a7ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405027.095083:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd442057a00/0x24b3e2e6dcd7a7ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405027.095110:0:22695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729018880:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784405027.095181:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405027.098988:0:22695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4427d10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784405027.109095:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729018880 00000100:00100000:1.0:1784405027.109110:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729018880 00000100:00100000:1.0:1784405027.109175:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784405027.109186:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+11:22695:x1871083729018880:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784405027.109202:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784405027.109224:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd57331d000/0x24b3e2e6dcd7a7c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a7ba expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405027.109251:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd57331d000/0x24b3e2e6dcd7a7c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a7ba expref: 12 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405027.109262:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd57331d000/0x24b3e2e6dcd7a7c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a7ba expref: 12 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405027.109271:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331d000, rc 0) 00000100:00100000:1.0:1784405027.109363:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:22695:x1871083729018880:12345-0@lo:101:mount.lustre.0 Request processed in 178us (14181us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405027.109370:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784405027.112939:0:22695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729018880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784405027.112972:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd442057a00/0x24b3e2e6dcd7a7ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a7c1 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405027.112984:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd442057a00/0x24b3e2e6dcd7a7ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a7c1 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405027.113071:0:22695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729019008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784405027.113136:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405027.113179:0:22695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44264ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1784405027.120272:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729019008 00000100:00100000:0.0:1784405027.120288:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729019008 00000100:00100000:0.0:1784405027.120345:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784405027.120355:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:22695:x1871083729019008:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784405027.120614:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:22695:x1871083729019008:12345-0@lo:501:mount.lustre.0 Request processed in 260us (7477us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405027.120622:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784405027.120994:0:22695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729019008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784405027.121059:0:22695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729019136:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784405027.121108:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405027.121142:0:22695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd44264ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1784405027.121200:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729019136 00000100:00100000:0.0:1784405027.121205:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729019136 00000100:00100000:0.0:1784405027.121233:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784405027.121240:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:22695:x1871083729019136:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784405027.121328:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:22695:x1871083729019136:12345-0@lo:503:mount.lustre.0 Request processed in 88us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405027.121335:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784405027.122597:0:22695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729019136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784405027.124713:0:22750:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22750:1871083729019264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784405027.124806:0:22750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405027.124876:0:22750:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd550a54900 going to sleep for 11 seconds 00000100:00100000:2.0:1784405027.125029:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729019264 00000100:00100000:2.0:1784405027.125039:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729019264 00000100:00100000:2.0:1784405027.125089:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784405027.125098:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:22750:x1871083729019264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784405027.125227:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:22750:x1871083729019264:12345-0@lo:502:llog_process_th.0 Request processed in 129us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405027.125235:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784405027.125346:0:22750:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22750:1871083729019264:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1784405027.125408:0:22750:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1784405027.125423:0:22750:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9dd56cb719c0) 00000020:00000080:3.0:1784405027.125442:0:22750:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1784405027.125615:0:22750:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd442282800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784405027.125619:0:22750:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd442282800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784405027.125621:0:22750:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd442282800 4 00010000:00080000:3.0:1784405027.125657:0:22750:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd577f03000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.142@tcp at head 00010000:00010000:3.0:1784405027.127244:0:22750:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1784405027.127366:0:22750:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1784405027.127406:0:22750:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784405027.127421:0:22750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x24b3e2e6dcd7a7cf 00000100:00080000:3.0:1784405027.127430:0:22750:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784405027.127436:0:22750:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dd577f03000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784405027.127474:0:22750:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd573b99c00 x1871083729019392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784405027.127524:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1871083729019392:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784405027.127598:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784405027.127659:0:22750:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784405027.127681:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784405027.127685:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784405027.127688:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd548764800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784405027.127691:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 644 00000100:00080000:3.0:1784405027.127696:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784405027.127700:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd548764800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784405027.127727:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd573b98000 x1871083729019520/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784405027.127742:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784405027.127746:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784405027.127748:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784405027.127750:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784405027.127766:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729019520:0@lo:38:kworker.0 00000100:00100000:3.0:1784405027.127814:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405027.127885:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729019520 00000100:00100000:3.0:1784405027.127891:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729019520 00000100:00100000:3.0:1784405027.127922:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784405027.127929:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1871083729019520:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784405027.127944:0:22723:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784405027.127985:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1871083729019520:12345-0@lo:38:kworker.0 Request processed in 54us (169us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784405027.127992:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1784405027.128026:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd548764800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784405027.128030:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784405027.128034:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729019520:0@lo:38:kworker.0 00000100:00100000:0.0:1784405027.130922:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729019392 00000100:00100000:0.0:1784405027.130938:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729019392 00000100:00100000:0.0:1784405027.131570:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784405027.131581:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1871083729019392:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784405027.131711:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1871083729019392:12345-0@lo:38:llog_process_th.0 Request processed in 128us (4110us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784405027.131719:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784405027.137182:0:22750:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22750:1871083729019648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784405027.137285:0:22750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405027.137331:0:22750:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4427d1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784405027.142018:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784405027.142035:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd577f03000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784405027.142043:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784405027.142048:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1871083729019392:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784405027.144841:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729019648 00000100:00100000:0.0:1784405027.144884:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729019648 00000100:00100000:0.0:1784405027.144955:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784405027.144966:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:22750:x1871083729019648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784405027.145161:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:22750:x1871083729019648:12345-0@lo:502:llog_process_th.0 Request processed in 195us (7875us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405027.145169:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784405027.145250:0:22750:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22750:1871083729019648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784405027.145318:0:22750:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22750:1871083729019776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784405027.145364:0:22750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405027.145390:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729019776 00000100:00100000:0.0:1784405027.145394:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729019776 00000100:00100000:0.0:1784405027.145416:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784405027.145423:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:22750:x1871083729019776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784405027.151097:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:22750:x1871083729019776:12345-0@lo:502:llog_process_th.0 Request processed in 5660us (5718us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405027.151117:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784405027.151235:0:22750:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b5ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784405027.151272:0:22750:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22750:1871083729019776:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784405027.151316:0:22750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1784405027.151607:0:22695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1784405027.151637:0:22695:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784405027.151726:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442057a00/0x24b3e2e6dcd7a7ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a7c1 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405027.151740:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd442057a00/0x24b3e2e6dcd7a7ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a7c1 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784405027.151809:0:22695:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784405027.151812:0:22695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784405027.151814:0:22695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784405027.151815:0:22695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784405027.151816:0:22695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784405027.151823:0:22695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784405027.151825:0:22695:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784405027.151826:0:22695:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784405027.151828:0:22695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784405027.151829:0:22695:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784405027.151832:0:22695:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1784405027.151835:0:22695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784405027.151836:0:22695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784405027.151837:0:22695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784405027.151838:0:22695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784405027.151838:0:22695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784405027.151839:0:22695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784405027.151840:0:22695:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784405027.151841:0:22695:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784405027.151842:0:22695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784405027.151842:0:22695:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784405027.151892:0:22695:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784405027.151911:0:22695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729019904:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784405027.151962:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405027.151994:0:22695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4427d1300 going to sleep for 11 seconds 00000100:00100000:3.0:1784405027.152956:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729019904 00000100:00100000:3.0:1784405027.152967:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729019904 00000100:00100000:3.0:1784405027.153022:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784405027.153033:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:22695:x1871083729019904:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784405027.153065:0:22712:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784405027.153082:0:22712:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784405027.155654:0:22712:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784405027.155745:0:22712:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1784405027.156550:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:22695:x1871083729019904:12345-0@lo:253:mount.lustre.0 Request processed in 3513us (4582us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405027.156563:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:0.0:1784405027.156977:0:22733:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784405027.156983:0:22733:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784405027.157018:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a7d6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.157035:0:22733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd7a7a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a79e expref: 11 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.157045:0:22733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a7d6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.157088:0:22733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd7a7a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a79e expref: 11 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.157103:0:22733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd7a7a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a79e expref: 11 pid: 22712 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405027.157117:0:22733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22733:1871083729020032:0@lo:104: 00000100:00100000:0.0:1784405027.157161:0:22733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405027.157202:0:22733:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b5ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784405027.157266:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729020032 00000100:00100000:3.0:1784405027.157274:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729020032 00000100:00100000:3.0:1784405027.157322:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784405027.157340:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+3:22733:x1871083729020032:12345-0@lo:104: 00010000:00010000:3.0:1784405027.157354:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a79e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a7a5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405027.157401:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784405027.157408:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+3:22733:x1871083729020032:12345-0@lo:104: Request processed in 70us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405027.157414:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1784405027.157464:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784405027.157480:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a79e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a7a5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.157489:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443549600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784405027.157493:0:22706:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a79e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a7a5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.157501:0:22706:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a79e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a7a5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784405027.157508:0:22706:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a79e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a7a5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784405027.157525:0:22706:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784405027.157561:0:22706:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a79e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a7a5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.157568:0:22706:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784405027.157590:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a79e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a7a5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.157597:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a79e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a7a5 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.157613:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405027.157615:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405027.157617:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784405027.157647:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3646:1871083729020160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784405027.157887:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405027.157962:0:22733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22733:1871083729020032:0@lo:104: 00010000:00010000:0.0:1784405027.157983:0:22733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a7d6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405027.161308:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729020160 00000100:00100000:0.0:1784405027.161323:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729020160 00010000:00010000:0.0:1784405027.161359:0:22702:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd7a7a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a79e expref: 12 pid: 22712 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405027.161460:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784405027.161544:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:3646:x1871083729020160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784405027.161560:0:22702:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784405027.161580:0:22702:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd7a7a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a79e expref: 12 pid: 22712 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.161593:0:22702:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd7a7a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a79e expref: 12 pid: 22712 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.161613:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443549400/0x24b3e2e6dcd7a7a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a79e expref: 12 pid: 22712 timeout: 745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.161628:0:22702:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a7d6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.161636:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a7d6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784405027.161654:0:22702:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004670866s 00010000:00010000:0.0:1784405027.161658:0:22702:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a7d6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.161746:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a7d6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.161753:0:22702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a7d6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.161759:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a7d6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.161765:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784405027.161770:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a7d6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.161799:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a7d6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.161817:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a7d6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.161829:0:22702:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784405027.161934:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+11:3646:x1871083729020160:12345-0@lo:103:ldlm_bl.0 Request processed in 464us (4082us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405027.161941:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784405027.161992:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3646:1871083729020160:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784405027.162019:0:22733:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a7d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.162027:0:22733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a7d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405027.162032:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a7d6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405027.162157:0:22695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22695:1871083729019904:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784405027.162169:0:22695:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1784405027.162173:0:22695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784405027.162174:0:22695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784405027.162182:0:22695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784405027.162184:0:22695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784405027.162185:0:22695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784405027.162186:0:22695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784405027.162187:0:22695:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784405027.162188:0:22695:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784405027.162190:0:22695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784405027.162191:0:22695:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784405027.162202:0:22695:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:3.0:1784405027.185228:0:22695:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:3.0:1784405027.185642:0:22695:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1784405027.186013:0:22757:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784405027.186579:0:22695:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:2.0:1784405027.187566:0:22695:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1784405027.187608:0:22695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1784405027.188068:0:22695:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1784405027.188078:0:22695:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1784405027.188117:0:22695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1784405027.189390:0:22758:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9dd573b98700 x1871083729020288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405027.189404:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 00000040:00080000:1.0:1784405027.189668:0:22757:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1784405027.190971:0:22756:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:0.0:1784405027.190978:0:22756:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:00080000:2.0:1784405027.191238:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784405027.192215:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784405027.192263:0:22695:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1784405027.193548:0:22757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784405027.193619:0:22757:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1784405027.194576:0:22695:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1784405027.195399:0:22695:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1784405027.200513:0:22695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1784405027.202984:0:22695:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1784405027.203033:0:22695:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc2ae01c6b988 00100000:10000000:2.0:1784405027.203043:0:22695:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1784405027.204663:0:22695:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784405027.204681:0:22695:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784405027.204704:0:22695:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1784405027.204733:0:22695:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1784405027.205651:0:22695:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784405027.205898:0:22695:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784405027.845924:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784405028.163392:0:22751:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1784405028.163403:0:22751:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784405028.164628:0:22751:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1784405028.164638:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1784405028.231628:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 10000000:01000000:3.0:1784405028.355001:0:22714:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784405028.355014:0:22714:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd442282800 from 11 10000000:01000000:3.0:1784405028.355021:0:22714:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784405028.355084:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056600/0x24b3e2e6dcd7a7dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405028.355098:0:22714:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd442056600/0x24b3e2e6dcd7a7dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405028.355111:0:22714:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd442056600/0x24b3e2e6dcd7a7dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405028.355377:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729020416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784405028.355465:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405028.356204:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd58160c480 going to sleep for 11 seconds 00000100:00100000:0.0:1784405028.356471:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729020416 00000100:00100000:0.0:1784405028.356488:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729020416 00000100:00100000:0.0:1784405028.356553:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784405028.356562:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+11:22714:x1871083729020416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784405028.356575:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405028.356595:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a7e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a7dd expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405028.356618:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a7e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a7dd expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405028.356628:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a7e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a7dd expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405028.356637:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549e00, rc 0) 00000100:00100000:0.0:1784405028.356699:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:22714:x1871083729020416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405028.356706:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784405028.356944:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729020416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784405028.356960:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd442056600/0x24b3e2e6dcd7a7dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a7e4 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405028.356970:0:22714:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd442056600/0x24b3e2e6dcd7a7dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a7e4 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405028.357024:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729020544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784405028.357054:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405028.357083:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd58160c480 going to sleep for 11 seconds 00000100:00100000:0.0:1784405028.357393:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729020544 00000100:00100000:0.0:1784405028.357398:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729020544 00000100:00100000:0.0:1784405028.357422:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784405028.357428:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:22714:x1871083729020544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784405028.357441:0:22712:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784405028.357456:0:22712:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784405028.357459:0:22712:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1784405028.357549:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:22714:x1871083729020544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405028.357556:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784405028.357678:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729020544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784405028.357718:0:22714:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784405028.357724:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056600/0x24b3e2e6dcd7a7dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a7e4 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405028.357733:0:22714:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd442056600/0x24b3e2e6dcd7a7dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a7e4 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405028.871018:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784405029.189896:0:22751:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1784405029.189909:0:22751:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784405029.190077:0:22751:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1784405029.190118:0:22751:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784405029.190281:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1784405029.253650:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 00010000:00010000:2.0:1784405029.893483:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784405030.279081:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 00010000:00010000:0.0:1784405030.916136:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784405031.309532:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 00010000:00010000:2.0:1784405031.939002:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784405032.210531:0:23000:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1784405032.323678:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 00000100:00080000:3.0:1784405032.329303:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784405032.329319:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784405032.329323:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd548764800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784405032.329331:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 645 00000100:00080000:3.0:1784405032.329337:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784405032.329344:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd548764800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784405032.329367:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd573b99f80 x1871083729020800/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784405032.329399:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784405032.329403:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784405032.329405:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784405032.329408:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784405032.329411:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784405032.329414:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784405032.329416:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd577f03000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784405032.329431:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dd577f03000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784405032.329444:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd573b99180 x1871083729020928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784405032.329479:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784405032.329495:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3646:1871083729020672:0@lo:400:kworker.0 00000100:00100000:3.0:1784405032.329567:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405032.332493:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729020672 00000100:00100000:3.0:1784405032.332504:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729020672 00000100:00100000:3.0:1784405032.332557:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784405032.332567:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:3646:x1871083729020672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405032.332668:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:3646:x1871083729020672:12345-0@lo:400:kworker.0 Request processed in 103us (3101us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405032.332675:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784405032.332722:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729020800:0@lo:38:kworker.0 00000100:00100000:3.0:1784405032.333024:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405032.333046:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1871083729020928:0@lo:38:kworker.0 00000100:00100000:3.0:1784405032.333085:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405032.333118:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729020800 00000100:00100000:3.0:1784405032.333122:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729020800 00000100:00100000:3.0:1784405032.333143:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784405032.333148:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1871083729020800:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784405032.333167:0:22723:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784405032.333200:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1871083729020800:12345-0@lo:38:kworker.0 Request processed in 51us (176us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784405032.333206:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1784405032.333241:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd548764800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784405032.333246:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784405032.333249:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729020800:0@lo:38:kworker.0 00000100:00100000:3.0:1784405032.333273:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3646:1871083729020672:0@lo:400:kworker.0 00000100:00100000:2.0:1784405032.337290:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729020928 00000100:00100000:2.0:1784405032.337305:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729020928 00000100:00100000:2.0:1784405032.337356:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784405032.337364:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1871083729020928:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784405032.337390:0:22719:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:2.0:1784405032.337432:0:22719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x24b3e2e6dcd7a7eb 00000004:00100000:2.0:1784405032.337448:0:22719:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784405032.337560:0:22719:0:(import.c:65:import_set_state_nolock()) ffff9dd573a3e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784405032.337662:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1871083729020928:12345-0@lo:38:kworker.0 Request processed in 297us (4574us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405032.337669:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784405032.339372:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dd573b99180 x1871083729020928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784405042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784405032.339393:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1784405032.339401:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784405032.339407:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784405032.339410:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd577f03000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784405032.339417:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1871083729020928:0@lo:38:kworker.0 00010000:00010000:1.0:1784405032.965167:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784405033.277407:0:23052:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784405033.277620:0:23052:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784405033.348238:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 00010000:00010000:0.0:1784405033.988251:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784405034.254764:0:23103:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784405034.255000:0:23103:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784405034.370957:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 00010000:00010000:0.0:1784405035.012364:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784405035.404214:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 00010000:00010000:0.0:1784405036.035092:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784405036.434373:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 00010000:00010000:1.0:1784405037.059700:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784405037.443113:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3648:1871083729021056:0@lo:400:kworker.0 00000100:00100000:0.0:1784405037.443189:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784405037.443258:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784405037.443262:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784405037.443272:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd548764800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784405037.443277:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 650 00000100:00080000:3.0:1784405037.443282:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784405037.443289:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd548764800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784405037.443312:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd573b99500 x1871083729021184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784405037.443331:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784405037.443334:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784405037.443337:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784405037.443340:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784405037.443386:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 00000100:00100000:1.0:1784405037.443420:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083729021312:0@lo:400:kworker.0 00000100:00100000:1.0:1784405037.443478:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405037.443651:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729021056 00000100:00100000:0.0:1784405037.443659:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729021056 00000100:00100000:0.0:1784405037.443723:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784405037.443732:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:3648:x1871083729021056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405037.443783:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:3648:x1871083729021056:12345-0@lo:400:kworker.0 Request processed in 52us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405037.443790:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784405037.443822:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729021312 00000100:00100000:0.0:1784405037.443826:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729021312 00000100:00100000:0.0:1784405037.443882:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784405037.443889:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083729021312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405037.443926:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083729021312:12345-0@lo:400:kworker.0 Request processed in 37us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405037.443932:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784405037.443970:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dd573b99f80 x1871083729021312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784405037.443983:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083729021312:0@lo:400:kworker.0 00000100:00100000:0.0:1784405037.444009:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3648:1871083729021056:0@lo:400:kworker.0 00000100:00100000:3.0:1784405037.447904:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784405027/real 1784405027] req@ffff9dd570592680 x1871083729017728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405037 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405037.448228:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd570592680 x1871083729017728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405037 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405037.448240:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784405027/real 1784405027] req@ffff9dd570590000 x1871083729017600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405037 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405037.448253:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd570590000 x1871083729017600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405037 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405037.448274:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729021184:0@lo:38:kworker.0 00000100:00100000:3.0:1784405037.448340:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784405037.448421:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd443585000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784405037.448452:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784405037.448466:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729017728:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1784405037.448485:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd57329b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784405037.448491:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784405037.448494:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729017600:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1784405037.449131:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784405037.449144:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784405037.449147:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd57329b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784405037.449153:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 644 00000100:00080000:1.0:1784405037.449159:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784405037.449167:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dd57329b000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784405037.449200:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd574d36300 x1871083729021440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784405037.449224:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784405037.449228:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784405037.449231:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd443585000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784405037.449235:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 644 00000100:00080000:1.0:1784405037.449238:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784405037.449242:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd443585000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784405037.449254:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd574d37800 x1871083729021568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784405037.449824:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729021440:0@lo:8:kworker.0 00000400:00000100:3.0:1784405037.449883:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083729021440 offset 0 length 520: 4 00000100:00100000:3.0:1784405037.449915:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729021568:0@lo:8:kworker.0 00000400:00000100:3.0:1784405037.449934:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083729021568 offset 0 length 520: 4 00000100:00100000:0.0:1784405037.450482:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729021184 00000100:00100000:0.0:1784405037.450490:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729021184 00000100:00100000:0.0:1784405037.452032:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784405037.452044:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1871083729021184:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784405037.452083:0:22723:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784405037.483985:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1871083729021184:12345-0@lo:38:kworker.0 Request processed in 31934us (35637us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784405037.484000:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1784405037.484056:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd548764800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784405037.484061:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784405037.484066:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729021184:0@lo:38:kworker.0 00010000:00010000:0.0:1784405038.094021:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784405038.467957:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 00010000:00010000:3.0:1784405039.112230:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784405039.431551:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784405039.494733:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 00010000:00010000:1.0:1784405040.132175:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784405040.518368:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 00000020:01000004:0.0:1784405040.967604:0:23447:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784405040.967607:0:23447:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1784405040.967609:0:23447:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1784405040.967737:0:23447:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9dd54851a800 00000020:01000004:0.0:1784405040.967755:0:23447:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1784405040.967768:0:23447:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784405040.967781:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9dd573a8cd40) 00000020:00000080:0.0:1784405040.967797:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784405041.041444:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1784405041.042789:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784405041.046209:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1784405041.046818:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1784405041.047160:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1784405041.047340:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1784405041.047639:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1784405041.047839:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1784405041.048321:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1784405041.048685:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1784405041.048949:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1784405041.049152:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1784405041.049368:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1784405041.049655:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1784405041.050113:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1784405041.050722:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1784405041.050938:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1784405041.051135:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1784405041.051539:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1784405041.051896:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1784405041.052109:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1784405041.052339:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1784405041.052627:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1784405041.052983:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1784405041.053166:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1784405041.053390:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1784405041.053682:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1784405041.053904:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1784405041.054169:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1784405041.054399:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1784405041.054634:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1784405041.054873:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1784405041.055091:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1784405041.055329:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1784405041.055632:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1784405041.055837:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1784405041.056145:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1784405041.056485:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1784405041.056731:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1784405041.056938:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1784405041.057186:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1784405041.057369:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1784405041.057652:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1784405041.057891:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1784405041.058107:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1784405041.058295:0:23447:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00080000:01000000:3.0:1784405041.059519:0:23447:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784405041.059828:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1784405041.059841:0:23447:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784405041.059956:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b3e2e6dcd7a7f9 00000020:01000004:3.0:1784405041.059963:0:23447:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1784405041.059985:0:23447:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.142@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784405041.059988:0:23447:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784405041.059995:0:23447:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1784405041.060019:0:23447:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1784405041.060024:0:23447:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1784405041.064814:0:23447:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784405041.065175:0:23447:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.142@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1784405041.065180:0:23447:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784405041.065182:0:23447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784405041.065183:0:23447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784405041.065185:0:23447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784405041.065187:0:23447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784405041.065188:0:23447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784405041.065189:0:23447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784405041.065195:0:23447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784405041.065197:0:23447:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784405041.065201:0:23447:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1784405041.065203:0:23447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784405041.065204:0:23447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784405041.065205:0:23447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784405041.065206:0:23447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784405041.065207:0:23447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784405041.065208:0:23447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784405041.065209:0:23447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784405041.065210:0:23447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784405041.065211:0:23447:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784405041.065238:0:23447:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1784405041.065260:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729021696:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784405041.065326:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405041.065411:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b21b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784405041.065489:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729021696 00000100:00100000:3.0:1784405041.065748:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729021696 00000100:00100000:3.0:1784405041.065844:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784405041.065874:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:23447:x1871083729021696:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784405041.065911:0:22710:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1784405041.065914:0:22710:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1784405041.065921:0:22710:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1784405041.066195:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:23447:x1871083729021696:12345-0@lo:253:mount.lustre.0 Request processed in 322us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405041.066204:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784405041.066281:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729021696:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784405041.066290:0:23447:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1784405041.066292:0:23447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784405041.066294:0:23447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784405041.066295:0:23447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784405041.066296:0:23447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784405041.066298:0:23447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784405041.066299:0:23447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784405041.066300:0:23447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784405041.066301:0:23447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784405041.066302:0:23447:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784405041.066317:0:23447:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd54851a800 from lustre-MDT0001 10000000:01000000:2.0:1784405041.066353:0:23447:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1784405041.066356:0:23447:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1784405041.066363:0:23447:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dd44213b380 local copy 00010000:00010000:2.0:1784405041.066372:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd7a6ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a6f6 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405041.066449:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729021824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784405041.066481:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405041.066692:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b21480 going to sleep for 11 seconds 00000100:00100000:0.0:1784405041.066770:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729021824 00000100:00100000:0.0:1784405041.066775:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729021824 00000100:00100000:0.0:1784405041.066798:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784405041.066805:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:23447:x1871083729021824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784405041.066887:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:23447:x1871083729021824:12345-0@lo:501:mount.lustre.0 Request processed in 82us (406us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784405041.066894:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784405041.066998:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729021824:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1784405041.067011:0:23447:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1784405041.067026:0:23447:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1784405041.067032:0:23447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd7a6ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a6f6 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.067042:0:23447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd7a6ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a6f6 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784405041.067064:0:23447:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd54851a800 10000000:01000000:2.0:1784405041.067068:0:23447:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784405041.067071:0:23447:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9dd44213b380 10000000:01000000:2.0:1784405041.067074:0:23447:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1784405041.067077:0:23447:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9dd44213b380 from 1 10000000:01000000:2.0:1784405041.067079:0:23447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784405041.067099:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7a00/0x24b3e2e6dcd7a800 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.067107:0:23447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7a00/0x24b3e2e6dcd7a800 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.067116:0:23447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7a00/0x24b3e2e6dcd7a800 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405041.067127:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729021952:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784405041.067148:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405041.067178:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b21480 going to sleep for 11 seconds 00000100:00100000:0.0:1784405041.067211:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729021952 00000100:00100000:0.0:1784405041.067215:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729021952 00000100:00100000:0.0:1784405041.067239:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784405041.067244:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+12:23447:x1871083729021952:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784405041.067260:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405041.067272:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443548a00/0x24b3e2e6dcd7a807 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a800 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.067290:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443548a00/0x24b3e2e6dcd7a807 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a800 expref: 13 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.067299:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443548a00/0x24b3e2e6dcd7a807 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a800 expref: 13 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.067308:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443548a00, rc 0) 00000100:00100000:0.0:1784405041.067338:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+13:23447:x1871083729021952:12345-0@lo:101:mount.lustre.0 Request processed in 93us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405041.067397:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784405041.067482:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729021952:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784405041.067494:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7a00/0x24b3e2e6dcd7a800 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a807 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.067502:0:23447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7a00/0x24b3e2e6dcd7a800 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a807 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784405041.067515:0:23447:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784405041.067529:0:23447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7a00/0x24b3e2e6dcd7a800 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a807 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.067536:0:23447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7a00/0x24b3e2e6dcd7a800 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a807 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784405041.067542:0:23447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dd54851a800 10000000:01000000:2.0:1784405041.067545:0:23447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784405041.067548:0:23447:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9dd54851a800 from 1 10000000:01000000:2.0:1784405041.067549:0:23447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784405041.067666:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a80e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.067674:0:23447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a80e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.067681:0:23447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a80e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405041.067692:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729022080:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784405041.067715:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405041.067740:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b21480 going to sleep for 11 seconds 00000100:00100000:0.0:1784405041.067775:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729022080 00000100:00100000:0.0:1784405041.067778:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729022080 00000100:00100000:0.0:1784405041.067803:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784405041.067808:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+13:23447:x1871083729022080:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784405041.067815:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405041.067821:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443549a00/0x24b3e2e6dcd7a815 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a80e expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.067834:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443549a00/0x24b3e2e6dcd7a815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a80e expref: 14 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.067842:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443549a00/0x24b3e2e6dcd7a815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a80e expref: 14 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.067882:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549a00, rc 0) 00000100:00100000:0.0:1784405041.067913:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+14:23447:x1871083729022080:12345-0@lo:101:mount.lustre.0 Request processed in 105us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405041.067919:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784405041.068025:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729022080:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784405041.068036:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a80e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a815 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.068043:0:23447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a80e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a815 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784405041.068052:0:23447:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784405041.068064:0:23447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a80e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a815 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.068071:0:23447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7e00/0x24b3e2e6dcd7a80e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a815 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784405041.068077:0:23447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1784405041.068080:0:23447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784405041.068084:0:23447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dd54851a800 10000000:01000000:2.0:1784405041.068086:0:23447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784405041.068089:0:23447:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1784405041.068090:0:23447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1784405041.068101:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7a81c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.068108:0:23447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7a81c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.068114:0:23447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7a81c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405041.068134:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729022208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784405041.068155:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405041.068169:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b21480 going to sleep for 11 seconds 00000100:00100000:0.0:1784405041.068233:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729022208 00000100:00100000:0.0:1784405041.068237:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729022208 00000100:00100000:0.0:1784405041.068288:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784405041.068294:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+14:23447:x1871083729022208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784405041.068300:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405041.068307:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443548600/0x24b3e2e6dcd7a823 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a81c expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.068319:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443548600/0x24b3e2e6dcd7a823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a81c expref: 15 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.068326:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443548600/0x24b3e2e6dcd7a823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a81c expref: 15 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.068333:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443548600, rc 0) 00000100:00100000:0.0:1784405041.068369:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+15:23447:x1871083729022208:12345-0@lo:101:mount.lustre.0 Request processed in 75us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405041.068374:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784405041.068417:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729022208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784405041.068426:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7a81c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a823 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.068434:0:23447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7a81c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a823 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784405041.070471:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1784405041.071152:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784405041.075424:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1784405041.075481:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1784405041.075499:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1784405041.075512:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1784405041.075525:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1784405041.075539:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1784405041.075552:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1784405041.075636:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1784405041.075652:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1784405041.075680:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1784405041.075694:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1784405041.075706:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1784405041.075719:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1784405041.075733:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1784405041.075747:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1784405041.075760:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1784405041.075775:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1784405041.075803:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1784405041.075817:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1784405041.075831:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1784405041.075844:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1784405041.075946:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1784405041.075963:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1784405041.075977:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1784405041.075990:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1784405041.076001:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1784405041.076012:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1784405041.076025:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1784405041.076039:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1784405041.076052:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1784405041.076064:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1784405041.076077:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1784405041.076093:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1784405041.076107:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1784405041.076119:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1784405041.076132:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1784405041.076146:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1784405041.076159:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1784405041.076173:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1784405041.076188:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1784405041.076203:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1784405041.076218:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1784405041.076231:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1784405041.076243:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1784405041.076270:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1784405041.076276:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1784405041.076454:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729022336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784405041.076520:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405041.076693:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b21780 going to sleep for 11 seconds 00000100:00100000:3.0:1784405041.076745:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729022336 00000100:00100000:3.0:1784405041.077025:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729022336 00000100:00100000:2.0:1784405041.077185:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784405041.077195:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+15:23447:x1871083729022336:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784405041.077356:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+15:23447:x1871083729022336:12345-0@lo:501:mount.lustre.0 Request processed in 153us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405041.077364:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784405041.077441:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729022336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784405041.077482:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729022464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784405041.077529:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405041.077730:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd58160c540 going to sleep for 11 seconds 00000100:00100000:0.0:1784405041.077815:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729022464 00000100:00100000:0.0:1784405041.077820:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729022464 00000100:00100000:0.0:1784405041.077847:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784405041.077875:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+15:23447:x1871083729022464:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784405041.078518:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+15:23447:x1871083729022464:12345-0@lo:503:mount.lustre.0 Request processed in 643us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405041.078526:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784405041.078702:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729022464:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784405041.079157:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784405041.079226:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729022592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784405041.079269:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405041.079291:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd58160c540 going to sleep for 11 seconds 00000100:00100000:0.0:1784405041.079361:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729022592 00000100:00100000:0.0:1784405041.079366:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729022592 00000100:00100000:0.0:1784405041.079390:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784405041.079397:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+15:23447:x1871083729022592:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784405041.080155:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+15:23447:x1871083729022592:12345-0@lo:502:mount.lustre.0 Request processed in 755us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405041.080164:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784405041.080252:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729022592:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784405041.080461:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1784405041.080487:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1784405041.080500:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1784405041.080512:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1784405041.080523:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1784405041.080534:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1784405041.080548:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1784405041.080571:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1784405041.080584:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1784405041.080595:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1784405041.080607:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1784405041.080618:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1784405041.080630:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1784405041.080644:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1784405041.080691:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1784405041.080709:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1784405041.080723:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1784405041.080737:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1784405041.080755:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1784405041.080769:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1784405041.080782:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1784405041.080806:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1784405041.080821:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1784405041.080834:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1784405041.080847:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1784405041.080904:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1784405041.080918:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1784405041.080933:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1784405041.080945:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1784405041.080957:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1784405041.080970:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1784405041.080982:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1784405041.080996:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1784405041.081009:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1784405041.081021:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1784405041.081036:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1784405041.081050:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1784405041.081063:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1784405041.081076:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1784405041.081088:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1784405041.081102:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1784405041.081115:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1784405041.081127:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1784405041.081139:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1784405041.081174:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729022720:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784405041.081220:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405041.081245:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd58160c540 going to sleep for 11 seconds 00000100:00100000:0.0:1784405041.081769:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729022720 00000100:00100000:0.0:1784405041.081777:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729022720 00000100:00100000:0.0:1784405041.081813:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784405041.081821:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+15:23447:x1871083729022720:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784405041.081946:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+15:23447:x1871083729022720:12345-0@lo:502:mount.lustre.0 Request processed in 125us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405041.081954:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784405041.084045:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729022720:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784405041.084144:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1784405041.084157:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1784405041.087782:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784405041.087799:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784405041.087801:0:23452:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1784405041.087809:0:23452:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1784405041.087812:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784405041.087828:0:23452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9dd573a899c0) 00000020:00000080:0.0:1784405041.087883:0:23452:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1784405041.087892:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784405041.087958:0:23452:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784405041.087965:0:23452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b3e2e6dcd7a831 00000020:00000080:0.0:1784405041.088750:0:23452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1784405041.088756:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784405041.088761:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784405041.088762:0:23452:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1784405041.088765:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784405041.088776:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784405041.088778:0:23452:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1784405041.088782:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784405041.088792:0:23452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9dd573a88000) 00000020:00000080:0.0:1784405041.088805:0:23452:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1784405041.088810:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784405041.088812:0:23452:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1784405041.088815:0:23452:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1784405041.088820:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784405041.089107:0:23452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd54851a800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1784405041.089121:0:23452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9dd5445f8000) 00000020:00000080:0.0:1784405041.089130:0:23452:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1784405041.089195:0:23452:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784405041.089202:0:23452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd7a846 00000020:00000080:0.0:1784405041.089298:0:23452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1784405041.089305:0:23452:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784405041.089309:0:23452:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x24b3e2e6dcd7a84d 00080000:01000000:0.0:1784405041.089315:0:23452:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784405041.089319:0:23452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b3e2e6dcd7a854 00010000:00010000:3.0:1784405041.157551:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405041.219237:0:23452:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1784405041.220223:0:23452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1784405041.220763:0:23452:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1784405041.222401:0:23452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1784405041.222420:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784405041.222438:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405041.222440:0:23452:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1784405041.222444:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784405041.222450:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405041.222451:0:23452:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1784405041.222454:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784405041.222459:0:23452:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:00000080:3.0:1784405041.222504:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784405041.222524:0:23452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9dd56cb70000) 00000020:00000080:3.0:1784405041.222547:0:23452:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1784405041.222561:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784405041.222630:0:23452:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1784405041.222636:0:23452:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784405041.222642:0:23452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b3e2e6dcd7a862 00010000:00080000:3.0:1784405041.222688:0:23452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd44254c000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.142@tcp at head 00010000:00010000:3.0:1784405041.224306:0:23452:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1784405041.231699:0:23452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784405041.231716:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1784405041.231762:0:23452:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784405041.231787:0:23452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd7a869 00000100:00080000:3.0:1784405041.231810:0:23452:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784405041.231816:0:23452:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dd44254c000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784405041.231883:0:23452:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd573b9a300 x1871083729022848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784405041.231914:0:23452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784405041.232170:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729022848:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784405041.232246:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405041.232322:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729022848 00000100:00100000:0.0:1784405041.232329:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729022848 00000100:00100000:0.0:1784405041.232368:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784405041.232376:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1871083729022848:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784405041.232402:0:22722:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 659 last 0 00000020:00000080:0.0:1784405041.232435:0:22722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd7a870 00000004:00100000:0.0:1784405041.232450:0:22722:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1784405041.232456:0:22722:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000020:01000000:3.0:1784405041.233188:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784405041.233194:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405041.233196:0:23452:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1784405041.233200:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784405041.233202:0:23452:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1784405041.233215:0:23452:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784405041.233217:0:23452:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784405041.233218:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784405041.233221:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405041.233222:0:23452:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784405041.233225:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784405041.233229:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405041.233230:0:23452:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1784405041.233234:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00080000:1.0:1784405041.233914:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784405041.233920:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1784405041.233924:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd548764800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784405041.233930:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 655 00000100:00080000:1.0:1784405041.233934:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784405041.233940:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd548764800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784405041.233987:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd574d37b80 x1871083729023104/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784405041.234015:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000004:01000000:3.0:1784405041.234170:0:23452:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1784405041.234199:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784405041.234203:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405041.234205:0:23452:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1784405041.234208:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784405041.234210:0:23452:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1784405041.234211:0:23452:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784405041.234213:0:23452:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784405041.234214:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784405041.234216:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405041.234218:0:23452:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784405041.234220:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784405041.234224:0:23452:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1784405041.234227:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405041.234228:0:23452:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1784405041.234231:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784405041.234235:0:23452:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:01000000:3.0:1784405041.234259:0:23452:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1784405041.234262:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000100:00080000:1.0:1784405041.234450:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784405041.234453:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784405041.234456:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784405041.234506:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3646:1871083729022976:0@lo:400:kworker.0 00000020:00000080:3.0:1784405041.234631:0:23452:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9dd56cb73380) 00000020:00000080:3.0:1784405041.234652:0:23452:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1784405041.234670:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784405041.234772:0:23452:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1784405041.234779:0:23452:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784405041.234792:0:23452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b3e2e6dcd7a87e 00000100:00100000:0.0:1784405041.234943:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083729023232:0@lo:400:kworker.0 00000100:00100000:0.0:1784405041.235010:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405041.235206:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729023232 00000100:00100000:0.0:1784405041.235214:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729023232 00000100:00100000:0.0:1784405041.235258:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784405041.235266:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083729023232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405041.235465:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083729023232:12345-0@lo:400:kworker.0 Request processed in 199us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405041.235474:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784405041.235514:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dd574d37480 x1871083729023232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784405041.235528:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083729023232:0@lo:400:kworker.0 00000100:00100000:1.0:1784405041.235671:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405041.235716:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729022976 00000100:00100000:1.0:1784405041.235720:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729022976 00000100:00100000:1.0:1784405041.235749:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784405041.235755:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+15:3646:x1871083729022976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405041.235791:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+15:3646:x1871083729022976:12345-0@lo:400:kworker.0 Request processed in 36us (120us total) trans 0 rc 0/0 00010000:00080000:3.0:1784405041.236162:0:23452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd443339000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.142@tcp at head 00000100:00100000:1.0:1784405041.236445:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784405041.236499:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3646:1871083729022976:0@lo:400:kworker.0 00000100:00100000:1.0:1784405041.236527:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729023104:0@lo:38:kworker.0 00000100:00100000:1.0:1784405041.238263:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405041.239323:0:22723:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1784405041.239334:0:22723:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00010000:3.0:1784405041.240267:0:23452:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:3.0:1784405041.245941:0:23452:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1784405041.246249:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729023104 00000100:00100000:2.0:1784405041.246260:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729023104 00000100:00080000:2.0:1784405041.246823:0:22722:0:(import.c:65:import_set_state_nolock()) ffff9dd546701800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784405041.246953:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1871083729022848:12345-0@lo:38:llog_process_th.0 Request processed in 14566us (14697us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405041.246971:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784405041.246995:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784405041.247002:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1871083729023104:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784405041.248209:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784405041.248222:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1784405041.248250:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1784405041.248256:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784405041.248260:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd44254c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784405041.248274:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729022848:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784405041.248423:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729023360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784405041.248477:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405041.248637:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1871083729023104:12345-0@lo:38:kworker.0 Request processed in 1632us (10374us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784405041.248646:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784405041.248678:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729023360 00000100:00100000:2.0:1784405041.248683:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729023360 00000100:00100000:2.0:1784405041.248711:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784405041.248719:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1871083729023360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784405041.248747:0:22722:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1784405041.248791:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1871083729023360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405041.248820:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784405041.248877:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729023360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784405041.249252:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784405041.249259:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd548764800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784405041.249264:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784405041.249267:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729023104:0@lo:38:kworker.0 00000040:01000000:3.0:1784405041.250813:0:23452:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1784405041.255038:0:23452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784405041.257991:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1784405041.258205:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1784405041.273599:0:23458:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1784405041.273609:0:23458:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1784405041.285003:0:23452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784405041.285030:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784405041.285079:0:23452:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784405041.285105:0:23452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd7a885 00000100:00080000:1.0:1784405041.285116:0:23452:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784405041.285122:0:23452:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dd443339000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784405041.285160:0:23452:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd574d34380 x1871083729023488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784405041.285204:0:23452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1784405041.285292:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729023488:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1784405041.285367:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083729023488 offset 0 length 520: 4 00000020:01000000:1.0:1784405041.285606:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784405041.285611:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405041.285613:0:23452:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1784405041.285616:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784405041.285619:0:23452:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1784405041.285621:0:23452:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784405041.285622:0:23452:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784405041.285624:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784405041.285626:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405041.285627:0:23452:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784405041.285630:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784405041.285634:0:23452:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1784405041.285637:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405041.285639:0:23452:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1784405041.285642:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784405041.285645:0:23452:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.142@tcp to nid 0x20000c0a8ca8e (192.168.202.142@tcp) 00000020:01000000:1.0:1784405041.285678:0:23452:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1784405041.285682:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784405041.285695:0:23452:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9dd442138000) 00000020:00000080:1.0:1784405041.285710:0:23452:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1784405041.285716:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784405041.285790:0:23452:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1784405041.285809:0:23452:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784405041.285815:0:23452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x24b3e2e6dcd7a893 00010000:00080000:1.0:1784405041.285870:0:23452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd574d7e800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.142@tcp at head 00010000:00010000:1.0:1784405041.286238:0:23452:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1784405041.286314:0:23452:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784405041.286329:0:23452:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1784405041.290249:0:23452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784405041.290647:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1784405041.291320:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:3.0:1784405041.291836:0:23460:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1784405041.291841:0:23460:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1784405041.292779:0:23452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784405041.292794:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784405041.292834:0:23452:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784405041.292885:0:23452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd7a89a 00000100:00080000:2.0:1784405041.292896:0:23452:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784405041.292902:0:23452:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd574d7e800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784405041.292964:0:23452:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd5732b9500 x1871083729023616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784405041.293041:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729023616:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1784405041.293104:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083729023616 offset 0 length 520: 4 00000100:00080000:2.0:1784405041.293252:0:23452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1784405041.293308:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784405041.293312:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784405041.293314:0:23452:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1784405041.293317:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784405041.293321:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784405041.293322:0:23452:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784405041.293325:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784405041.293326:0:23452:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784405041.293328:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784405041.293330:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784405041.293332:0:23452:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784405041.293334:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784405041.293336:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784405041.293337:0:23452:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784405041.293341:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1784405041.293364:0:23452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784405041.293367:0:23452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784405041.293368:0:23452:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784405041.293370:0:23452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1784405041.293428:0:23447:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1784405041.293455:0:23447:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784405041.293469:0:23447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7a81c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a823 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.293481:0:23447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6800/0x24b3e2e6dcd7a81c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a823 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784405041.293490:0:23447:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd54851a800 from 1 10000000:01000000:2.0:1784405041.293493:0:23447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784405041.293515:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a8a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.293522:0:23447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a8a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.293533:0:23447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a8a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405041.293547:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729023744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784405041.293820:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405041.293914:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5739b49c0 going to sleep for 11 seconds 00000100:00080000:0.0:1784405041.294351:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784405041.294356:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784405041.294359:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784405041.294362:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784405041.294374:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784405041.294377:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784405041.294378:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784405041.294381:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784405041.294523:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729023744 00000100:00100000:3.0:1784405041.294530:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729023744 00000100:00100000:3.0:1784405041.294934:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784405041.294961:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+15:23447:x1871083729023744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784405041.294977:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784405041.294998:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a8a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a8a1 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405041.295239:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a8a1 expref: 16 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405041.295252:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a8a1 expref: 16 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405041.295262:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442057800, rc 0) 00000100:00100000:2.0:1784405041.295382:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+16:23447:x1871083729023744:12345-0@lo:101:mount.lustre.0 Request processed in 437us (1560us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405041.295389:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784405041.295463:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729023744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784405041.295480:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a8a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a8a8 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405041.295503:0:23447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a8a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a8a8 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405041.296121:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729023872:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1784405041.296166:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405041.297037:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510a4540 going to sleep for 11 seconds 00000100:00100000:1.0:1784405041.297265:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729023872 00000100:00100000:1.0:1784405041.297272:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729023872 00000100:00100000:1.0:1784405041.297316:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784405041.297325:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+16:23447:x1871083729023872:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1784405041.297413:0:22711:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1784405041.297436:0:22711:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784405041.297439:0:22711:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1784405041.297726:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+16:23447:x1871083729023872:12345-0@lo:256:mount.lustre.0 Request processed in 401us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405041.297735:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784405041.298160:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729023872:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1784405041.299450:0:23447:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784405041.299520:0:23447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a8a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a8a8 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.299534:0:23447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a8a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a8a8 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784405041.299616:0:23447:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd54851a800 from 1 10000000:01000000:2.0:1784405041.299619:0:23447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784405041.299667:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6200/0x24b3e2e6dcd7a8af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.299675:0:23447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6200/0x24b3e2e6dcd7a8af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.299685:0:23447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6200/0x24b3e2e6dcd7a8af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405041.299709:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729024000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784405041.299763:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405041.299889:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5739b4600 going to sleep for 11 seconds 00000100:00100000:1.0:1784405041.300032:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729024000 00000100:00100000:1.0:1784405041.300040:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729024000 00000100:00100000:1.0:1784405041.300092:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784405041.300102:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+16:23447:x1871083729024000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784405041.300113:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784405041.300125:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd57331d200/0x24b3e2e6dcd7a8b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a8af expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.300146:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd57331d200/0x24b3e2e6dcd7a8b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a8af expref: 17 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.300156:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd57331d200/0x24b3e2e6dcd7a8b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a8af expref: 17 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.300164:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331d200, rc 0) 00000100:00100000:1.0:1784405041.300219:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:23447:x1871083729024000:12345-0@lo:101:mount.lustre.0 Request processed in 118us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405041.300225:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784405041.300475:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729024000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784405041.300491:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6200/0x24b3e2e6dcd7a8af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a8b6 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.300500:0:23447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6200/0x24b3e2e6dcd7a8af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a8b6 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784405041.301617:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1784405041.302227:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784405041.302622:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1784405041.302664:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1784405041.302682:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1784405041.302698:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1784405041.302712:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1784405041.302737:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1784405041.302750:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1784405041.302762:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1784405041.302775:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1784405041.302793:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1784405041.302918:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1784405041.303225:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1784405041.303233:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1784405041.303335:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729024128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784405041.303408:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405041.303455:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5739b46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784405041.303690:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729024128 00000100:00100000:1.0:1784405041.303697:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729024128 00000100:00100000:1.0:1784405041.303750:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784405041.303760:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:23447:x1871083729024128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784405041.303920:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:23447:x1871083729024128:12345-0@lo:501:mount.lustre.0 Request processed in 161us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405041.303927:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784405041.304236:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729024128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784405041.304276:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729024256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784405041.304323:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405041.304361:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510a4540 going to sleep for 11 seconds 00000100:00100000:1.0:1784405041.304455:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729024256 00000100:00100000:1.0:1784405041.304459:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729024256 00000100:00100000:1.0:1784405041.304480:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784405041.304486:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:23447:x1871083729024256:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784405041.304641:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:23447:x1871083729024256:12345-0@lo:503:mount.lustre.0 Request processed in 154us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405041.304649:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784405041.305246:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729024256:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784405041.306169:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784405041.306252:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729024384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784405041.306311:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405041.306340:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510a4540 going to sleep for 11 seconds 00000100:00100000:1.0:1784405041.306452:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729024384 00000100:00100000:1.0:1784405041.306459:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729024384 00000100:00100000:1.0:1784405041.306502:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784405041.306512:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:23447:x1871083729024384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784405041.307205:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:23447:x1871083729024384:12345-0@lo:502:mount.lustre.0 Request processed in 693us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405041.307214:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784405041.307466:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729024384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784405041.308440:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1784405041.308480:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1784405041.308498:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1784405041.308513:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1784405041.308527:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1784405041.308541:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1784405041.308629:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1784405041.308650:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1784405041.308679:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1784405041.308694:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1784405041.308707:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1784405041.308747:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729024512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784405041.309120:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405041.309165:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5739b4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784405041.309228:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729024512 00000100:00100000:1.0:1784405041.309235:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729024512 00000100:00100000:1.0:1784405041.309313:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784405041.309330:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:23447:x1871083729024512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784405041.309457:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:23447:x1871083729024512:12345-0@lo:502:mount.lustre.0 Request processed in 128us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405041.309465:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784405041.309545:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729024512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784405041.309611:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1784405041.309620:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1784405041.310464:0:23462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784405041.310474:0:23462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405041.310477:0:23462:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784405041.310491:0:23462:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd54851a800 00000020:00000080:3.0:1784405041.310494:0:23462:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784405041.310501:0:23462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784405041.310504:0:23462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405041.310505:0:23462:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784405041.310508:0:23462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784405041.310511:0:23462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405041.310512:0:23462:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784405041.310515:0:23462:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd54851a800 00000020:00000080:3.0:1784405041.310517:0:23462:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784405041.310570:0:23462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784405041.310575:0:23462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405041.310577:0:23462:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1784405041.310579:0:23462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784405041.310582:0:23462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405041.310583:0:23462:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784405041.310587:0:23462:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd54851a800 00000020:00000080:3.0:1784405041.310589:0:23462:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784405041.310607:0:23462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784405041.310610:0:23462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405041.310611:0:23462:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784405041.310614:0:23462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784405041.310617:0:23462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405041.310618:0:23462:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1784405041.310621:0:23462:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd54851a800 00000020:00000080:3.0:1784405041.310623:0:23462:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784405041.310644:0:23462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784405041.310647:0:23462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405041.310648:0:23462:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1784405041.310651:0:23462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1784405041.310778:0:23447:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1784405041.310804:0:23447:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784405041.310823:0:23447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6200/0x24b3e2e6dcd7a8af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a8b6 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.310834:0:23447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6200/0x24b3e2e6dcd7a8af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a8b6 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784405041.310906:0:23447:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784405041.310909:0:23447:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd54851a800 10000000:01000000:0.0:1784405041.310912:0:23447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd54851a800 10000000:01000000:0.0:1784405041.310916:0:23447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784405041.310921:0:23447:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd54851a800 from 1 10000000:01000000:0.0:1784405041.310924:0:23447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784405041.310964:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548400/0x24b3e2e6dcd7a8bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.310983:0:23447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd443548400/0x24b3e2e6dcd7a8bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.310993:0:23447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd443548400/0x24b3e2e6dcd7a8bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405041.311012:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729024640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784405041.311066:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405041.315683:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729024640 00000100:00100000:2.0:1784405041.315701:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729024640 00000100:00100000:2.0:1784405041.315766:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784405041.315775:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54a7b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:23447:x1871083729024640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784405041.315792:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784405041.316942:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd442057200/0x24b3e2e6dcd7a8c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a8bd expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405041.316993:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd442057200/0x24b3e2e6dcd7a8c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a8bd expref: 18 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405041.317011:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd442057200/0x24b3e2e6dcd7a8c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a8bd expref: 18 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405041.318269:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e3ff00 going to sleep for 11 seconds 00010000:00010000:3.0:1784405041.319441:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442057200, rc 0) 00000100:00100000:3.0:1784405041.319538:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54a7b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:23447:x1871083729024640:12345-0@lo:101:mount.lustre.0 Request processed in 3761us (8467us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405041.319547:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784405041.330575:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729024640:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784405041.330610:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd443548400/0x24b3e2e6dcd7a8bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a8c4 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.330624:0:23447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd443548400/0x24b3e2e6dcd7a8bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a8c4 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784405041.338219:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1784405041.338534:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784405041.341814:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1784405041.341880:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1784405041.341902:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1784405041.341916:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1784405041.341948:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1784405041.341965:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1784405041.341983:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1784405041.341999:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1784405041.342014:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1784405041.344601:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1784405041.344626:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1784405041.344640:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1784405041.344651:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1784405041.344675:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1784405041.344686:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1784405041.344698:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1784405041.344722:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1784405041.344737:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1784405041.344749:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1784405041.344763:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1784405041.344808:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1784405041.344826:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1784405041.344879:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1784405041.344897:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1784405041.344911:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1784405041.344924:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1784405041.344938:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1784405041.344968:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1784405041.344984:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1784405041.344998:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1784405041.345013:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1784405041.345158:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1784405041.345173:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1784405041.345185:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1784405041.345198:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1784405041.345212:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1784405041.345241:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1784405041.345256:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1784405041.345270:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1784405041.345282:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1784405041.345294:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1784405041.345304:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1784405041.345315:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1784405041.345325:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1784405041.345336:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1784405041.345418:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1784405041.345438:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1784405041.345452:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1784405041.345623:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1784405041.345645:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1784405041.345676:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1784405041.345683:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1784405041.345788:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729024768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784405041.345875:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405041.345927:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5739b49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784405041.349704:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729024768 00000100:00100000:1.0:1784405041.349721:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729024768 00000100:00100000:1.0:1784405041.349790:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784405041.349801:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54a7b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:23447:x1871083729024768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784405041.350005:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54a7b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:23447:x1871083729024768:12345-0@lo:501:mount.lustre.0 Request processed in 206us (4151us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405041.350022:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784405041.350122:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729024768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784405041.350176:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729024896:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784405041.350227:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405041.350262:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5739b49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784405041.351371:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729024896 00000100:00100000:1.0:1784405041.351379:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729024896 00000100:00100000:1.0:1784405041.351430:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784405041.351439:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54a7b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:23447:x1871083729024896:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784405041.351584:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54a7b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:23447:x1871083729024896:12345-0@lo:503:mount.lustre.0 Request processed in 146us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405041.351592:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784405041.351668:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729024896:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784405041.352190:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784405041.352270:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729025024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784405041.352312:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405041.352341:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5739b46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784405041.353139:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729025024 00000100:00100000:1.0:1784405041.353146:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729025024 00000100:00100000:1.0:1784405041.353191:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784405041.353199:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54a7b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:23447:x1871083729025024:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784405041.353331:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54a7b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:23447:x1871083729025024:12345-0@lo:502:mount.lustre.0 Request processed in 131us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405041.353338:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784405041.354142:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729025024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784405041.354373:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1784405041.354403:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1784405041.354419:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1784405041.354433:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1784405041.354446:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1784405041.354458:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1784405041.354472:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1784405041.354484:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1784405041.354499:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1784405041.354513:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1784405041.354527:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1784405041.354541:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1784405041.354565:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1784405041.354581:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1784405041.354612:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1784405041.354635:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1784405041.354667:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1784405041.354701:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1784405041.354722:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1784405041.354744:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1784405041.354765:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1784405041.354784:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1784405041.354801:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1784405041.354819:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1784405041.354869:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1784405041.354888:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1784405041.354903:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1784405041.354918:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1784405041.354932:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1784405041.354948:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1784405041.354982:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1784405041.355007:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1784405041.356455:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1784405041.356484:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1784405041.356500:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1784405041.356516:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1784405041.356535:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1784405041.356550:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1784405041.358278:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1784405041.358305:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1784405041.358320:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1784405041.358335:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1784405041.362172:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1784405041.362215:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1784405041.362231:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1784405041.362245:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1784405041.362278:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1784405041.362297:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1784405041.362977:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729025152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784405041.363475:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405041.363522:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5739b46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784405041.365785:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729025152 00000100:00100000:3.0:1784405041.365800:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729025152 00000100:00100000:3.0:1784405041.365876:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784405041.365886:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54a7b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:23447:x1871083729025152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784405041.366040:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54a7b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:23447:x1871083729025152:12345-0@lo:502:mount.lustre.0 Request processed in 155us (2565us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405041.366048:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784405041.366228:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729025152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784405041.366525:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1784405041.366556:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1784405041.366595:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729025280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784405041.366644:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405041.366693:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729025280 00000100:00100000:2.0:1784405041.366699:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5739b46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784405041.366708:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729025280 00000100:00100000:1.0:1784405041.366824:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784405041.366832:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54a7b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:23447:x1871083729025280:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784405041.366938:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54a7b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:23447:x1871083729025280:12345-0@lo:502:mount.lustre.0 Request processed in 107us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405041.366945:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784405041.368175:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729025280:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784405041.368472:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1784405041.368485:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1784405041.373921:0:23467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1784405041.373943:0:23467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9dd5445f99c0) 00000020:00000080:0.0:1784405041.373967:0:23467:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1784405041.377037:0:23467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd54851a800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1784405041.377047:0:23467:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd54851a800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1784405041.377051:0:23467:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd54851a800 3 00010000:00080000:2.0:1784405041.377094:0:23467:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd574d78000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.142@tcp at head 00010000:00010000:3.0:1784405041.382425:0:23467:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1784405041.383168:0:23467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1784405041.383337:0:23467:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784405041.383355:0:23467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x24b3e2e6dcd7a8d2 00000100:00080000:3.0:1784405041.383368:0:23467:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784405041.383374:0:23467:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dd574d78000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784405041.383413:0:23467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd573b98a80 x1871083729025408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784405041.383458:0:23467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784405041.383505:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1871083729025408:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784405041.383585:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784405041.390494:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784405041.390503:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784405041.390506:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784405041.390508:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784405041.391416:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729025408 00000100:00100000:0.0:1784405041.391429:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729025408 00000100:00100000:0.0:1784405041.391472:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784405041.391481:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1871083729025408:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784405041.391508:0:22719:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 659 last 0 00000040:00080000:1.0:1784405041.391795:0:23467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:00000080:0.0:1784405041.392190:0:22719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x24b3e2e6dcd7a8d9 00000004:00100000:0.0:1784405041.392208:0:22719:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784405041.392321:0:22719:0:(import.c:65:import_set_state_nolock()) ffff9dd573842800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784405041.392422:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1871083729025408:12345-0@lo:38:llog_process_th.0 Request processed in 941us (8836us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405041.392443:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1784405041.392509:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dd573b98a80 x1871083729025408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784405051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784405041.392522:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784405041.392533:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000020:01000000:3.0:1784405041.392724:0:23447:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1784405041.392757:0:23447:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784405041.392774:0:23447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548400/0x24b3e2e6dcd7a8bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a8c4 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405041.392784:0:23447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd443548400/0x24b3e2e6dcd7a8bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a8c4 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784405041.392833:0:23447:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784405041.392835:0:23447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784405041.392836:0:23447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784405041.392838:0:23447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784405041.392839:0:23447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784405041.392840:0:23447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784405041.392842:0:23447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784405041.392844:0:23447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784405041.392845:0:23447:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784405041.392871:0:23447:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1784405041.392874:0:23447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784405041.392875:0:23447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784405041.392877:0:23447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784405041.392878:0:23447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784405041.392879:0:23447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784405041.392880:0:23447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784405041.392881:0:23447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784405041.392883:0:23447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784405041.392884:0:23447:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784405041.392904:0:23447:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1784405041.392924:0:23447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729025536:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784405041.392974:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405041.393008:0:23447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510a4840 going to sleep for 11 seconds 00000100:00100000:3.0:1784405041.393044:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729025536 00000100:00100000:3.0:1784405041.393049:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729025536 00000100:00080000:0.0:1784405041.393702:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784405041.393709:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784405041.393713:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd574d78000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784405041.393721:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1871083729025408:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784405041.393760:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784405041.393770:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54a7b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:23447:x1871083729025536:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784405041.393796:0:22711:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1784405041.393810:0:22711:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1784405041.400484:0:22696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1784405041.400532:0:22711:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784405041.400720:0:22711:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1784405041.400777:0:22733:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784405041.400782:0:22733:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784405041.400803:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a8e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.400821:0:22733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a7e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a7dd expref: 18 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.400829:0:22733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a8a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a8a1 expref: 18 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.400872:0:22733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a8e0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.400909:0:22733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8a1 expref: 18 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.400925:0:22733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a8a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8a1 expref: 18 pid: 22712 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405041.400939:0:22733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22733:1871083729025664:0@lo:104: 00000100:00100000:0.0:1784405041.401002:0:22733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405041.401107:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729025664 00000100:00100000:2.0:1784405041.401116:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729025664 00000100:00100000:2.0:1784405041.401158:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784405041.401167:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+3:22733:x1871083729025664:12345-0@lo:104: 00010000:00010000:2.0:1784405041.401179:0:22701:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a8a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a8a8 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405041.401229:0:22701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784405041.401236:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+3:22733:x1871083729025664:12345-0@lo:104: Request processed in 71us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405041.401243:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1784405041.402390:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784405041.402401:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a8a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a8a8 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.402411:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784405041.402414:0:22705:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a8a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a8a8 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.402424:0:22705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a8a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a8a8 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784405041.402431:0:22705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a8a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a8a8 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784405041.402436:0:22705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784405041.402476:0:22705:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a8a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a8a8 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.402482:0:22705:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784405041.402503:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a8a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a8a8 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.402510:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7a8a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a8a8 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.402529:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405041.402530:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405041.402532:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784405041.402840:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3649:1871083729025920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784405041.402918:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405041.402975:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729025920 00000100:00100000:1.0:1784405041.402982:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729025920 00010000:00010000:1.0:1784405041.403005:0:22702:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a8a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8a1 expref: 19 pid: 22712 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405041.403043:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784405041.403052:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+19:3649:x1871083729025920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784405041.403066:0:22702:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784405041.403072:0:22702:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a8a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8a1 expref: 19 pid: 22712 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.403159:0:22733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a7e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a7dd expref: 19 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.403172:0:22733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a7e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a7dd expref: 19 pid: 22711 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405041.403183:0:22733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22733:1871083729025792:0@lo:104: 00000100:00100000:0.0:1784405041.403403:0:22733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405041.403440:0:22733:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443c13300 going to sleep for 11 seconds 00000100:00100000:0.0:1784405041.403463:0:22733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22733:1871083729025664:0@lo:104: 00000100:00100000:0.0:1784405041.403977:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54a7b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+19:23447:x1871083729025536:12345-0@lo:253:mount.lustre.0 Request processed in 10207us (11000us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405041.403987:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:1.0:1784405041.404483:0:22702:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8a1 expref: 18 pid: 22712 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.404505:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a8a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8a1 expref: 18 pid: 22712 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.404522:0:22702:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784405041.404667:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729025792 00000100:00100000:0.0:1784405041.404675:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729025792 00000100:00100000:0.0:1784405041.404722:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784405041.404732:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+3:22733:x1871083729025792:12345-0@lo:104: 00010000:00010000:0.0:1784405041.404754:0:22701:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd442056600/0x24b3e2e6dcd7a7dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a7e4 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405041.405374:0:23447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:23447:1871083729025536:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784405041.405399:0:23447:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1784405041.405402:0:23447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784405041.405404:0:23447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784405041.405405:0:23447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784405041.405407:0:23447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784405041.405409:0:23447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784405041.405410:0:23447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784405041.405412:0:23447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784405041.405413:0:23447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784405041.405415:0:23447:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784405041.405436:0:23447:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1784405041.405925:0:22701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784405041.405934:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+3:22733:x1871083729025792:12345-0@lo:104: Request processed in 1204us (2530us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405041.405944:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1784405041.405976:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784405041.405983:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd442056600/0x24b3e2e6dcd7a7dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a7e4 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.405992:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784405041.405996:0:22706:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd442056600/0x24b3e2e6dcd7a7dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a7e4 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.406006:0:22706:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd442056600/0x24b3e2e6dcd7a7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a7e4 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784405041.406026:0:22706:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd442056600/0x24b3e2e6dcd7a7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a7e4 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784405041.406032:0:22706:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784405041.406069:0:22706:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd442056600/0x24b3e2e6dcd7a7dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a7e4 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.406076:0:22706:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784405041.406109:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd442056600/0x24b3e2e6dcd7a7dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a7e4 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.406116:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd442056600/0x24b3e2e6dcd7a7dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a7e4 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405041.406142:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405041.406144:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405041.406146:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784405041.406155:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784405041.406168:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3647:1871083729026048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784405041.406225:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405041.406289:0:22733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22733:1871083729025792:0@lo:104: 00010000:00010000:0.0:1784405041.406314:0:22733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a8e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405041.407900:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:3649:x1871083729025920:12345-0@lo:103:ldlm_bl.0 Request processed in 4829us (4961us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405041.407915:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784405041.407946:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729026048 00000100:00100000:1.0:1784405041.407953:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729026048 00010000:00010000:1.0:1784405041.407995:0:22702:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a7e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a7dd expref: 17 pid: 22711 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405041.408026:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784405041.408035:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:3647:x1871083729026048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784405041.408049:0:22702:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784405041.408054:0:22702:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a7e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a7dd expref: 17 pid: 22711 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.408065:0:22702:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a7e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a7dd expref: 17 pid: 22711 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.408091:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a7e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a7dd expref: 17 pid: 22711 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.408108:0:22702:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a8e0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.408116:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a8e0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784405041.408133:0:22702:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007351143s 00010000:00010000:1.0:1784405041.408138:0:22702:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a8e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.408144:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a8e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.408151:0:22702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a8e0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.408158:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a8e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.408171:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784405041.408175:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a8e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.408183:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a8e0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.408205:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a8e0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.408225:0:22702:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784405041.408268:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+16:3647:x1871083729026048:12345-0@lo:103:ldlm_bl.0 Request processed in 235us (2045us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405041.408275:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784405041.408357:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3647:1871083729026048:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784405041.408385:0:22733:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a8e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.408393:0:22733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a8e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405041.408399:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443548800/0x24b3e2e6dcd7a8e0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405041.410118:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3649:1871083729025920:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1784405041.416501:0:23473:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1784405041.416510:0:23473:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1784405041.416608:0:23447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1784405041.417004:0:23474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784405041.417302:0:23447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1784405041.417845:0:23474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1784405041.418839:0:23447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1784405041.418914:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1784405041.419362:0:23447:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1784405041.419369:0:23447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1784405041.419416:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784405041.422441:0:23474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784405041.422553:0:23474:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1784405041.424095:0:23447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1784405041.424608:0:23447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1784405041.424645:0:23447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1784405041.424785:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1784405041.425383:0:23447:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:3.0:1784405041.428506:0:23475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9a680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23475:1871083729026176:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784405041.428591:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405041.428687:0:23475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd543d78e40 going to sleep for 11 seconds 00000001:00000004:3.0:1784405041.429690:0:23447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1784405041.430208:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729026176 00000100:00100000:0.0:1784405041.430289:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729026176 00000100:00100000:0.0:1784405041.430497:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784405041.430509:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23475:x1871083729026176:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1784405041.430632:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23475:x1871083729026176:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 125us (2040us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405041.430640:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784405041.430724:0:23475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9a680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23475:1871083729026176:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1784405041.430769:0:23475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1784405041.430812:0:23475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23475:1871083729026304:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784405041.430879:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405041.431143:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729026304 00000100:00100000:3.0:1784405041.431148:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729026304 00000100:00100000:3.0:1784405041.431177:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784405041.431185:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23475:x1871083729026304:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784405041.431290:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23475:x1871083729026304:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 106us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405041.431303:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784405041.432827:0:23475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b5e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784405041.432968:0:23475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23475:1871083729026304:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784405041.433444:0:23475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23475:1871083729026432:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1784405041.433505:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405041.433570:0:23475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b5ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1784405041.433622:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729026432 00000100:00100000:3.0:1784405041.433629:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729026432 00000100:00100000:3.0:1784405041.438922:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784405041.438940:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23475:x1871083729026432:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1784405041.439942:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23475:x1871083729026432:12345-0@lo:900:lod0001_rec0000.0 Request processed in 1003us (6431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405041.439954:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784405041.440715:0:23475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dd574d34000 x1871083729026432/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784405057 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405041.440733:0:23475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23475:1871083729026432:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1784405041.440815:0:23475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23475:1871083729026560:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784405041.441031:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405041.441058:0:23475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b5e180 going to sleep for 11 seconds 00000100:00100000:3.0:1784405041.441171:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729026560 00000100:00100000:3.0:1784405041.441179:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729026560 00000100:00100000:3.0:1784405041.441234:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784405041.441244:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23475:x1871083729026560:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784405041.441500:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23475:x1871083729026560:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 257us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405041.441508:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784405041.441760:0:23475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23475:1871083729026560:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1784405041.441822:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1784405041.448820:0:23447:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1784405041.448893:0:23447:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffc2ae0151b988 00100000:10000000:3.0:1784405041.448901:0:23447:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1784405041.449501:0:23447:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784405041.449532:0:23447:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784405041.449562:0:23447:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1784405041.449584:0:23447:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1784405041.451574:0:23447:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784405041.451839:0:23447:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1784405041.453293:0:23475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784405041.465754:0:23475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784405041.465762:0:23475:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000100:00100000:3.0:1784405041.542999:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 00010000:00010000:3.0:1784405042.180900:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784405042.435456:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1784405042.435732:0:22714:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784405042.435737:0:22714:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd54851a800 from 12 10000000:01000000:1.0:1784405042.435741:0:22714:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784405042.435909:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd57331d800/0x24b3e2e6dcd7a8e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405042.435929:0:22714:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd57331d800/0x24b3e2e6dcd7a8e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405042.435943:0:22714:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd57331d800/0x24b3e2e6dcd7a8e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405042.435969:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729026688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784405042.436038:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405042.436083:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b5e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784405042.436180:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729026688 00000100:00100000:0.0:1784405042.436187:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729026688 00000100:00100000:0.0:1784405042.436627:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784405042.436639:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54a7b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+16:22714:x1871083729026688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784405042.436662:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405042.436678:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443549600/0x24b3e2e6dcd7a8ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a8e7 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405042.436710:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443549600/0x24b3e2e6dcd7a8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a8e7 expref: 17 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405042.436720:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443549600/0x24b3e2e6dcd7a8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a8e7 expref: 17 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405042.436730:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549600, rc 0) 00000100:00100000:0.0:1784405042.436797:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54a7b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:22714:x1871083729026688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405042.436803:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784405042.438696:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729026688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784405042.438722:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd57331d800/0x24b3e2e6dcd7a8e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a8ee expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405042.438735:0:22714:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd57331d800/0x24b3e2e6dcd7a8e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a8ee expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405042.438813:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729026816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784405042.438883:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405042.440941:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b5e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784405042.441027:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729026816 00000100:00100000:2.0:1784405042.441035:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729026816 00000100:00100000:2.0:1784405042.441081:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784405042.441089:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:22714:x1871083729026816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784405042.441111:0:22710:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784405042.441129:0:22710:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784405042.441132:0:22710:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1784405042.441237:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:22714:x1871083729026816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 148us (2353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405042.441246:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784405042.446421:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729026816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784405042.446481:0:22714:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784405042.446492:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd57331d800/0x24b3e2e6dcd7a8e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a8ee expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405042.446502:0:22714:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd57331d800/0x24b3e2e6dcd7a8e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a8ee expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784405042.446522:0:22714:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784405042.447014:0:22714:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd442282800 from 12 10000000:01000000:1.0:1784405042.447019:0:22714:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784405042.447052:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd57331c000/0x24b3e2e6dcd7a8f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405042.447061:0:22714:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd57331c000/0x24b3e2e6dcd7a8f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405042.447070:0:22714:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd57331c000/0x24b3e2e6dcd7a8f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405042.447093:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729026944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784405042.447151:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405042.447196:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b5e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784405042.447240:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729026944 00000100:00100000:0.0:1784405042.447247:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729026944 00000100:00100000:0.0:1784405042.447293:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784405042.447303:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:22714:x1871083729026944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784405042.447316:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405042.447328:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443549c00/0x24b3e2e6dcd7a8fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a8f5 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405042.447350:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443549c00/0x24b3e2e6dcd7a8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a8f5 expref: 18 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405042.447361:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443549c00/0x24b3e2e6dcd7a8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a8f5 expref: 18 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405042.447370:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549c00, rc 0) 00000100:00100000:0.0:1784405042.447406:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:22714:x1871083729026944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405042.447421:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784405042.449697:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729026944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784405042.449726:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd57331c000/0x24b3e2e6dcd7a8f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a8fc expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405042.449738:0:22714:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd57331c000/0x24b3e2e6dcd7a8f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a8fc expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405042.449805:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729027072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784405042.449880:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405042.449923:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b5e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784405042.449945:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729027072 00000100:00100000:1.0:1784405042.449950:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729027072 00000100:00100000:1.0:1784405042.450001:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784405042.450008:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:22714:x1871083729027072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784405042.450027:0:22712:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784405042.450042:0:22712:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784405042.450045:0:22712:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1784405042.450120:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:22714:x1871083729027072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405042.450127:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784405042.450165:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729027072:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784405042.450201:0:22714:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784405042.450208:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd57331c000/0x24b3e2e6dcd7a8f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a8fc expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405042.450215:0:22714:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd57331c000/0x24b3e2e6dcd7a8f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a8fc expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405042.576623:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 00010000:00010000:3.0:1784405043.204439:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784405043.461829:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784405043.587236:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 00010000:00010000:1.0:1784405044.227713:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784405044.613607:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 00010000:00010000:0.0:1784405045.251786:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784405045.634942:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 00000001:02000400:0.0:1784405046.044421:0:23718:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784405046.275017:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784405046.659451:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 0 seconds 00000100:00080000:3.0:1784405046.664481:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784405046.664501:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784405046.664514:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd548764800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784405046.664526:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9dd548764800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784405046.664549:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd573b9a680 x1871083729027328/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784405046.664567:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784405046.664570:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784405046.664573:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784405046.664575:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784405046.664600:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784405046.664603:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784405046.664605:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784405046.664619:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784405046.666143:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3647:1871083729027200:0@lo:400:kworker.0 00000100:00100000:3.0:1784405046.666218:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405046.666284:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784405046.666293:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083729027712:0@lo:400:kworker.0 00000100:00100000:3.0:1784405046.666326:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405046.666363:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729027328:0@lo:38:kworker.0 00000100:00100000:3.0:1784405046.666392:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405046.666421:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083729027456:0@lo:400:kworker.0 00000100:00100000:3.0:1784405046.666446:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405046.666472:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784405046.666478:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729027584:0@lo:400:kworker.0 00000100:00100000:3.0:1784405046.666500:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405046.666824:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729027712 00000100:00100000:3.0:1784405046.666831:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729027712 00000100:00100000:3.0:1784405046.666898:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729027456 00000100:00100000:3.0:1784405046.666902:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729027456 00000100:00100000:3.0:1784405046.666918:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784405046.666926:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083729027712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405046.667839:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729027328 00000100:00100000:1.0:1784405046.667847:0:23457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729027328 00000100:00100000:1.0:1784405046.667901:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729027584 00000100:00100000:1.0:1784405046.667905:0:23457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729027584 00000100:00100000:1.0:1784405046.667927:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784405046.667933:0:23457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1871083729027328:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784405046.667963:0:23457:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 664 last 0 00000020:00000080:1.0:1784405046.668011:0:23457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd7a903 00000100:00100000:2.0:1784405046.668200:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784405046.668212:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729027584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405046.668311:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729027200 00000100:00100000:0.0:1784405046.668316:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729027200 00000100:00100000:0.0:1784405046.668349:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784405046.668357:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:3647:x1871083729027200:12345-0@lo:400:kworker.0 00000004:00100000:1.0:1784405046.669645:0:23457:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1784405046.669654:0:23457:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1784405046.670133:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083729027712:12345-0@lo:400:kworker.0 Request processed in 3202us (3800us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405046.670144:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784405046.670171:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784405046.670180:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083729027456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405046.670321:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083729027456:12345-0@lo:400:kworker.0 Request processed in 144us (3874us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405046.670327:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1784405046.670375:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd573b9a300 x1871083729027712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405046.670390:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083729027712:0@lo:400:kworker.0 00000100:00100000:2.0:1784405046.671078:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729027584:12345-0@lo:400:kworker.0 Request processed in 2866us (4573us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405046.671088:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784405046.671255:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729027584:0@lo:400:kworker.0 00010000:00080000:1.0:1784405046.671279:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd573b98a80 x1871083729027456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405046.671290:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083729027456:0@lo:400:kworker.0 00000100:00100000:0.0:1784405046.674905:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:3647:x1871083729027200:12345-0@lo:400:kworker.0 Request processed in 6542us (8679us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405046.674922:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784405046.676072:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784405046.676092:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729027840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784405046.676159:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405046.676490:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729027840 00000100:00100000:1.0:1784405046.676498:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729027840 00000100:00100000:1.0:1784405046.676550:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784405046.676560:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729027840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784405046.676592:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1784405046.676650:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729027840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405046.676657:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784405046.676696:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729027840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784405046.677878:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3647:1871083729027200:0@lo:400:kworker.0 00000100:00080000:1.0:1784405046.683403:0:23457:0:(import.c:65:import_set_state_nolock()) ffff9dd443e87800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784405046.683711:0:23457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1871083729027328:12345-0@lo:38:kworker.0 Request processed in 15775us (17316us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405046.683722:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1784405046.684670:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1784405046.684683:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1784405046.684689:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784405046.684692:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd548764800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1784405046.684748:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f77f24f8): req@ffff9dd573b98700 x1871083729020288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405046.684793:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729027328:0@lo:38:kworker.0 00000100:00100000:1.0:1784405046.684951:0:22758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405046.685139:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e67e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784405046.685387:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729027968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784405046.685416:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405046.689385:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729020288 00000100:00100000:3.0:1784405046.689404:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729020288 00000100:00100000:3.0:1784405046.689479:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729027968 00000100:00100000:3.0:1784405046.689483:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729027968 00000100:00100000:3.0:1784405046.689501:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784405046.689659:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784405046.689674:0:23457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3648:x1871083729027968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784405046.689716:0:23457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784405046.689830:0:23457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3648:x1871083729027968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 161us (4411us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405046.689838:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784405046.690594:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22758:x1871083729020288:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784405046.690725:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22758:x1871083729020288:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 359us (5774us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405046.690734:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784405046.690847:0:22758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22758:1871083729020288:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1784405046.690909:0:22758:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1784405046.690979:0:22758:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22758:1871083729028096:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784405046.691024:0:22758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405046.691050:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548576000 going to sleep for 11 seconds 00000100:00100000:3.0:1784405046.691173:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729028096 00000100:00100000:3.0:1784405046.691179:0:23457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729028096 00000100:00100000:3.0:1784405046.691218:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784405046.691226:0:23457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22758:x1871083729028096:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784405046.693016:0:23457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22758:x1871083729028096:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 1782us (1983us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405046.693030:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784405046.693203:0:22758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22758:1871083729028096:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784405046.693314:0:22758:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22758:1871083729028224:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784405046.693350:0:22758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405046.693385:0:22758:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548576000 going to sleep for 11 seconds 00000100:00100000:2.0:1784405046.693407:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729028224 00000100:00100000:2.0:1784405046.693412:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729028224 00000100:00100000:2.0:1784405046.693441:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784405046.693449:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22758:x1871083729028224:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784405046.693696:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22758:x1871083729028224:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 246us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405046.693704:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784405046.693732:0:22758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22758:1871083729028224:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1784405046.693786:0:22758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784405046.694725:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729027968:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1784405046.700255:0:22758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784405046.701720:0:22758:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:2.0:1784405046.701725:0:22758:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:2.0:1784405047.102127:0:23770:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784405047.102354:0:23770:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784405047.299207:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784405048.134477:0:23820:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784405048.135193:0:23820:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784405048.334101:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405049.347395:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784405049.510698:0:23869:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd08cdc0f0 20000000:00000080:1.0:1784405049.510718:0:23869:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd546a69800 uarg=0000000000000000 20000000:01000000:1.0:1784405049.510761:0:23869:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1784405049.510767:0:23869:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1784405049.510772:0:23869:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1784405049.512172:0:23870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1784405049.512438:0:23869:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784405049.518669:0:23869:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784405049.518703:0:23869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd57331c400/0x24b3e2e6dcd7a90a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405049.518723:0:23869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd4425c7400/0x24b3e2e6dcd7a7b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a7ac expref: 17 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405049.518731:0:23869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd57331d200/0x24b3e2e6dcd7a8b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a8af expref: 17 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405049.518739:0:23869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd57331c400/0x24b3e2e6dcd7a90a lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405049.518789:0:23869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd57331d200/0x24b3e2e6dcd7a8b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8af expref: 17 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405049.518804:0:23869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd57331d200/0x24b3e2e6dcd7a8b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8af expref: 17 pid: 22712 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405049.518819:0:23869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23869:1871083729028352:0@lo:104: 00000100:00100000:1.0:1784405049.518937:0:23869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784405049.518991:0:23869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd4425c7400/0x24b3e2e6dcd7a7b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a7ac expref: 17 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405049.518999:0:23869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd4425c7400/0x24b3e2e6dcd7a7b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a7ac expref: 17 pid: 22711 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405049.519023:0:23869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d35f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23869:1871083729028480:0@lo:104: 00000100:00100000:1.0:1784405049.519047:0:23869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405049.519062:0:23869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd574e3f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784405049.519129:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729028352 00000100:00100000:2.0:1784405049.519137:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729028352 00000100:00100000:2.0:1784405049.519176:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729028480 00000100:00100000:2.0:1784405049.519179:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729028480 00000100:00100000:2.0:1784405049.519204:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784405049.519212:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+4:23869:x1871083729028352:12345-0@lo:104: 00010000:00010000:2.0:1784405049.519223:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6200/0x24b3e2e6dcd7a8af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a8b6 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.519285:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784405049.519291:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+4:23869:x1871083729028352:12345-0@lo:104: Request processed in 80us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405049.519298:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784405049.519313:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784405049.519319:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+3:23869:x1871083729028480:12345-0@lo:104: 00010000:00010000:2.0:1784405049.519326:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd442057e00/0x24b3e2e6dcd7a7ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a7b3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.519357:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784405049.519362:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+3:23869:x1871083729028480:12345-0@lo:104: Request processed in 44us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405049.519367:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1784405049.519385:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784405049.519390:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6200/0x24b3e2e6dcd7a8af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a8b6 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.519398:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784405049.519402:0:22706:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6200/0x24b3e2e6dcd7a8af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a8b6 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.519410:0:22706:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6200/0x24b3e2e6dcd7a8af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a8b6 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784405049.519429:0:22706:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6200/0x24b3e2e6dcd7a8af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a8b6 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784405049.519435:0:22706:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784405049.519465:0:22706:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6200/0x24b3e2e6dcd7a8af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a8b6 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.519471:0:22706:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784405049.519503:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6200/0x24b3e2e6dcd7a8af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a8b6 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.519511:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6200/0x24b3e2e6dcd7a8af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a8b6 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.519524:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784405049.519527:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd442057e00/0x24b3e2e6dcd7a7ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a7b3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.519532:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057e00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:2.0:1784405049.519535:0:22706:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd442057e00/0x24b3e2e6dcd7a7ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a7b3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.519541:0:22706:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd442057e00/0x24b3e2e6dcd7a7ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a7b3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784405049.519547:0:22706:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd442057e00/0x24b3e2e6dcd7a7ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a7b3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784405049.519553:0:22706:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784405049.519572:0:22706:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd442057e00/0x24b3e2e6dcd7a7ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a7b3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.519577:0:22706:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784405049.519604:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd442057e00/0x24b3e2e6dcd7a7ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a7b3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.519611:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd442057e00/0x24b3e2e6dcd7a7ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a7b3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.519622:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405049.519624:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405049.519625:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784405049.519640:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784405049.519652:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3648:1871083729028608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784405049.519678:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405049.519705:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3646:1871083729028736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784405049.519727:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405049.519785:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729028608 00000100:00100000:2.0:1784405049.519789:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729028608 00010000:00010000:2.0:1784405049.519805:0:22703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd57331d200/0x24b3e2e6dcd7a8b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8af expref: 18 pid: 22712 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405049.519824:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729028736 00000100:00100000:2.0:1784405049.519827:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729028736 00010000:00010000:2.0:1784405049.519837:0:22703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd4425c7400/0x24b3e2e6dcd7a7b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a7ac expref: 19 pid: 22711 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405049.519874:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784405049.519881:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+19:3648:x1871083729028608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784405049.519902:0:22703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784405049.519907:0:22703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd57331d200/0x24b3e2e6dcd7a8b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8af expref: 19 pid: 22712 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.519917:0:22703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd57331d200/0x24b3e2e6dcd7a8b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8af expref: 19 pid: 22712 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.519932:0:22703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784405049.519959:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+19:3648:x1871083729028608:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405049.519966:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784405049.519979:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784405049.519986:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:3646:x1871083729028736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784405049.519994:0:22703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784405049.519998:0:22703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd4425c7400/0x24b3e2e6dcd7a7b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a7ac expref: 18 pid: 22711 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.520005:0:22703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd4425c7400/0x24b3e2e6dcd7a7b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a7ac expref: 18 pid: 22711 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.520017:0:22703:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd57331c400/0x24b3e2e6dcd7a90a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.520024:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd57331c400/0x24b3e2e6dcd7a90a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.520037:0:22703:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd57331c400/0x24b3e2e6dcd7a90a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.520045:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd57331c400/0x24b3e2e6dcd7a90a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.520058:0:22703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd57331c400/0x24b3e2e6dcd7a90a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.520064:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd57331c400/0x24b3e2e6dcd7a90a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.520069:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331c400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784405049.520073:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd57331c400/0x24b3e2e6dcd7a90a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.520080:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd57331c400/0x24b3e2e6dcd7a90a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.520089:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd57331c400/0x24b3e2e6dcd7a90a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405049.520098:0:22703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784405049.520124:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:3646:x1871083729028736:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405049.520129:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784405049.520165:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3646:1871083729028736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784405049.520184:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3648:1871083729028608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784405049.520267:0:23869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd57331d200/0x24b3e2e6dcd7a8b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8af expref: 17 pid: 22712 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405049.520278:0:23869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23869:1871083729028352:0@lo:104: 00010000:00010000:1.0:1784405049.520288:0:23869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd4425c7400/0x24b3e2e6dcd7a7b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a7ac expref: 16 pid: 22711 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405049.520295:0:23869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d35f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23869:1871083729028480:0@lo:104: 00010000:00010000:1.0:1784405049.520313:0:23869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd57331c400/0x24b3e2e6dcd7a90a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405049.520322:0:23869:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd57331c400/0x24b3e2e6dcd7a90a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405049.520328:0:23869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd57331c400/0x24b3e2e6dcd7a90a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405049.520334:0:23869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd57331c400/0x24b3e2e6dcd7a90a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405049.521527:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784405049.667665:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784405050.370970:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784405051.143835:0:22714:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784405051.143843:0:22714:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd54851a800 from 13 10000000:01000000:2.0:1784405051.143867:0:22714:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784405051.143918:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6400/0x24b3e2e6dcd7a911 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405051.143948:0:22714:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6400/0x24b3e2e6dcd7a911 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405051.143960:0:22714:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6400/0x24b3e2e6dcd7a911 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405051.143987:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729028864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784405051.144074:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405051.144114:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548576900 going to sleep for 11 seconds 00000100:00100000:2.0:1784405051.144135:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729028864 00000100:00100000:2.0:1784405051.144141:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729028864 00000100:00100000:2.0:1784405051.144188:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784405051.144197:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+16:22714:x1871083729028864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784405051.144209:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784405051.144222:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd4425c7800/0x24b3e2e6dcd7a918 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a911 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405051.144246:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd4425c7800/0x24b3e2e6dcd7a918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a911 expref: 17 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405051.144256:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd4425c7800/0x24b3e2e6dcd7a918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a911 expref: 17 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405051.144265:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7800, rc 0) 00000100:00100000:2.0:1784405051.144301:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:22714:x1871083729028864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405051.144307:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784405051.144364:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729028864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784405051.144377:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6400/0x24b3e2e6dcd7a911 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a918 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405051.144385:0:22714:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6400/0x24b3e2e6dcd7a911 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a918 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405051.144443:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729028992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784405051.144466:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405051.144481:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548576900 going to sleep for 11 seconds 00000100:00100000:2.0:1784405051.144493:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729028992 00000100:00100000:2.0:1784405051.144496:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729028992 00000100:00100000:2.0:1784405051.144517:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784405051.144523:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:22714:x1871083729028992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784405051.144642:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:22714:x1871083729028992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405051.144650:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784405051.144678:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729028992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784405051.144702:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729029120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784405051.144739:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405051.144750:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548576900 going to sleep for 11 seconds 00000100:00100000:2.0:1784405051.144762:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729029120 00000100:00100000:2.0:1784405051.144765:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729029120 00000100:00100000:2.0:1784405051.144785:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784405051.144791:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:22714:x1871083729029120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784405051.144893:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:22714:x1871083729029120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405051.144905:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784405051.144944:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729029120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784405051.145600:0:23925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1784405051.145663:0:22714:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1784405051.145684:0:22714:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784405051.145693:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6400/0x24b3e2e6dcd7a911 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a918 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405051.145703:0:22714:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6400/0x24b3e2e6dcd7a911 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a918 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784405051.145713:0:22714:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784405051.145715:0:22714:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd442282800 from 13 10000000:01000000:2.0:1784405051.145718:0:22714:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784405051.145744:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6000/0x24b3e2e6dcd7a91f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405051.145752:0:22714:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6000/0x24b3e2e6dcd7a91f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405051.145760:0:22714:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6000/0x24b3e2e6dcd7a91f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405051.145779:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729029248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784405051.145816:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405051.145832:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548576e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784405051.145846:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729029248 00000100:00100000:2.0:1784405051.145874:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729029248 00000100:00100000:2.0:1784405051.145911:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784405051.145918:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+17:22714:x1871083729029248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784405051.145927:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784405051.145936:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd4425c7200/0x24b3e2e6dcd7a926 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a91f expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405051.145954:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd4425c7200/0x24b3e2e6dcd7a926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a91f expref: 18 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405051.145964:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd4425c7200/0x24b3e2e6dcd7a926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a91f expref: 18 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405051.145972:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7200, rc 0) 00000100:00100000:2.0:1784405051.146001:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:22714:x1871083729029248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405051.146008:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784405051.146044:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729029248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784405051.146055:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6000/0x24b3e2e6dcd7a91f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a926 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405051.146064:0:22714:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6000/0x24b3e2e6dcd7a91f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a926 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405051.146105:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729029376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784405051.146128:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405051.146140:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548576e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784405051.146150:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729029376 00000100:00100000:2.0:1784405051.146153:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729029376 00000100:00100000:2.0:1784405051.146179:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784405051.146185:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:22714:x1871083729029376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784405051.146268:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:22714:x1871083729029376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405051.146275:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784405051.146301:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729029376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784405051.146323:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729029504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784405051.146355:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405051.146367:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548576e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784405051.146378:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729029504 00000100:00100000:2.0:1784405051.146381:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729029504 00000100:00100000:2.0:1784405051.146401:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784405051.146407:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:22714:x1871083729029504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784405051.146470:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:22714:x1871083729029504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405051.146477:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784405051.146517:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729029504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784405051.153291:0:23926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1784405051.153542:0:22714:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1784405051.153583:0:22714:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784405051.153596:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6000/0x24b3e2e6dcd7a91f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a926 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405051.153607:0:22714:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6000/0x24b3e2e6dcd7a91f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a926 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405051.397288:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784405051.779063:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784405041/real 1784405041] req@ffff9dd5732b9500 x1871083729023616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405051 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784405051.779100:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd5732b9500 x1871083729023616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405051 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784405051.779111:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784405041/real 1784405041] req@ffff9dd574d34380 x1871083729023488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405051 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784405051.779124:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd574d34380 x1871083729023488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405051 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784405051.779147:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784405051.779171:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1784405051.779174:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729023616:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1784405051.779179:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd443339000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784405051.779183:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1784405051.779186:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729023488:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1784405051.779317:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784405051.779322:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784405051.779324:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784405051.779327:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784405051.779354:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784405051.779357:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1784405051.779360:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd443339000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784405051.779364:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 659 00000100:00080000:0.0:1784405051.779376:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784405051.779382:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dd443339000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784405051.779403:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd570590a80 x1871083729030016/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784405051.779415:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784405051.779418:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784405051.779420:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784405051.779423:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 659 00000100:00080000:0.0:1784405051.779425:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784405051.779428:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd574d7e800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:0.0:1784405051.779438:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd570591500 x1871083729030144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784405051.779480:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083729030272:0@lo:400:kworker.0 00000100:00100000:0.0:1784405051.779544:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405051.779591:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784405051.779598:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729029632:0@lo:400:kworker.0 00000100:00100000:0.0:1784405051.779624:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405051.779652:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083729029760:0@lo:400:kworker.0 00000100:00100000:0.0:1784405051.779676:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405051.779694:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784405051.779700:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729029888:0@lo:400:kworker.0 00000100:00100000:0.0:1784405051.779720:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405051.779752:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729030272 00000100:00100000:0.0:1784405051.779759:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729030272 00000100:00100000:0.0:1784405051.779800:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729029760 00000100:00100000:0.0:1784405051.779803:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729029760 00000100:00100000:0.0:1784405051.779829:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784405051.779836:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083729030272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405051.779916:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083729030272:12345-0@lo:400:kworker.0 Request processed in 80us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405051.779923:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784405051.779938:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784405051.779944:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083729029760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405051.779975:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083729029760:12345-0@lo:400:kworker.0 Request processed in 31us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405051.779981:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784405051.779999:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729029632 00000100:00100000:0.0:1784405051.780002:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729029632 00000100:00100000:0.0:1784405051.780024:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729029888 00000100:00100000:0.0:1784405051.780027:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729029888 00000100:00100000:0.0:1784405051.780039:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784405051.780045:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1871083729029632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405051.780077:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1871083729029632:12345-0@lo:400:kworker.0 Request processed in 32us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405051.780083:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784405051.780094:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784405051.780100:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729029888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405051.780128:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729029888:12345-0@lo:400:kworker.0 Request processed in 28us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405051.780134:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784405051.780174:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729029888:0@lo:400:kworker.0 00010000:00080000:0.0:1784405051.780185:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd570592d80 x1871083729029760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784405051.780203:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083729029760:0@lo:400:kworker.0 00000100:00100000:0.0:1784405051.780230:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729029632:0@lo:400:kworker.0 00010000:00080000:0.0:1784405051.780239:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd570592a00 x1871083729030272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784405051.780248:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083729030272:0@lo:400:kworker.0 00000100:00100000:2.0:1784405051.780320:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729030016:0@lo:8:kworker.0 00000400:00000100:2.0:1784405051.780349:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083729030016 offset 0 length 520: 4 00000100:00100000:2.0:1784405051.780371:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729030144:0@lo:8:kworker.0 00000400:00000100:2.0:1784405051.780389:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083729030144 offset 0 length 520: 4 00000100:00100000:0.0:1784405051.786493:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784405051.786518:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729030400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784405051.786598:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405051.787378:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729030400 00000100:00100000:0.0:1784405051.787388:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729030400 00000100:00100000:0.0:1784405051.787445:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784405051.787454:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1871083729030400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784405051.787493:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784405051.787556:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1871083729030400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405051.787576:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784405051.787637:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729030400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784405051.789067:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784405051.789084:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729030528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784405051.789147:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405051.789246:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729030528 00000100:00100000:2.0:1784405051.789263:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729030528 00000100:00100000:2.0:1784405051.789346:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784405051.789357:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729030528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784405051.789389:0:22722:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1784405051.789439:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729030528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405051.789456:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784405051.795099:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729030528:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1784405052.293985:0:23448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1784405052.422066:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784405052.808504:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784405037/real 1784405037] req@ffff9dd574d36300 x1871083729021440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405052 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405052.808568:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd574d36300 x1871083729021440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405052 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405052.808579:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784405037/real 1784405037] req@ffff9dd574d37800 x1871083729021568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405052 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405052.808592:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd574d37800 x1871083729021568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405052 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784405052.808622:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd57329b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784405052.808647:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784405052.808652:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729021440:0@lo:8:kworker.0 00000100:00080000:3.0:1784405052.808658:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd443585000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784405052.808662:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784405052.808665:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729021568:0@lo:8:kworker.0 00000100:00080000:3.0:1784405052.808761:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784405052.808765:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784405052.808768:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd57329b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784405052.808773:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 655 00000100:00080000:3.0:1784405052.808778:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784405052.808785:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dd57329b000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784405052.808809:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd573b98000 x1871083729030912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784405052.808822:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784405052.808825:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784405052.808832:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd443585000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784405052.808836:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 655 00000100:00080000:3.0:1784405052.808839:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784405052.808842:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd443585000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784405052.808875:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd573b99c00 x1871083729031040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784405052.808899:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784405052.808903:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784405052.808906:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784405052.808908:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784405052.808950:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3649:1871083729030656:0@lo:400:kworker.0 00000100:00100000:3.0:1784405052.809026:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405052.809066:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083729031424:0@lo:400:kworker.0 00000100:00100000:3.0:1784405052.809092:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405052.809115:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784405052.809121:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729031296:0@lo:400:kworker.0 00000100:00100000:3.0:1784405052.809145:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405052.809175:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729030784:0@lo:400:kworker.0 00000100:00100000:3.0:1784405052.809199:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405052.809216:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784405052.809221:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083729031168:0@lo:400:kworker.0 00000100:00100000:3.0:1784405052.809255:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405052.809287:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729030656 00000100:00100000:3.0:1784405052.809294:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729030656 00000100:00100000:3.0:1784405052.809343:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784405052.809352:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:3649:x1871083729030656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405052.809399:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:3649:x1871083729030656:12345-0@lo:400:kworker.0 Request processed in 47us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405052.809406:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784405052.809436:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729031424 00000100:00100000:3.0:1784405052.809440:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729031424 00000100:00100000:3.0:1784405052.809463:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729031168 00000100:00100000:3.0:1784405052.809466:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729031168 00000100:00100000:3.0:1784405052.809479:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784405052.809484:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083729031424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405052.809516:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083729031424:12345-0@lo:400:kworker.0 Request processed in 31us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405052.809522:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784405052.809534:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784405052.809540:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083729031168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405052.809581:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083729031168:12345-0@lo:400:kworker.0 Request processed in 41us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405052.809587:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784405052.809604:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729031296 00000100:00100000:3.0:1784405052.809607:0:23457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729031296 00000100:00100000:3.0:1784405052.809627:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729030784 00000100:00100000:3.0:1784405052.809629:0:23457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729030784 00000100:00100000:3.0:1784405052.809642:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784405052.809648:0:23457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729031296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405052.809678:0:23457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729031296:12345-0@lo:400:kworker.0 Request processed in 30us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405052.809694:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784405052.809707:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784405052.809712:0:23457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083729030784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405052.809741:0:23457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083729030784:12345-0@lo:400:kworker.0 Request processed in 29us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405052.809747:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1784405052.809791:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd573b98700 x1871083729031168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405052.809804:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083729031168:0@lo:400:kworker.0 00000100:00100000:3.0:1784405052.809814:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729030784:0@lo:400:kworker.0 00000100:00100000:3.0:1784405052.809841:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729031296:0@lo:400:kworker.0 00000100:00100000:3.0:1784405052.809848:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3649:1871083729030656:0@lo:400:kworker.0 00010000:00080000:3.0:1784405052.809883:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd573b9ad80 x1871083729031424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405052.809891:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083729031424:0@lo:400:kworker.0 00000100:00100000:3.0:1784405052.809912:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729030912:0@lo:8:kworker.0 00000400:00000100:3.0:1784405052.809933:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083729030912 offset 0 length 520: 4 00000100:00100000:3.0:1784405052.809946:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729031040:0@lo:8:kworker.0 00000400:00000100:3.0:1784405052.809960:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871083729031040 offset 0 length 520: 4 00010000:00010000:1.0:1784405053.443079:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784405053.711383:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784405054.469749:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405055.494590:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405056.515504:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784405056.899813:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784405056.899839:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729031552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784405056.899930:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405056.900092:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729031552 00000100:00100000:1.0:1784405056.900099:0:23457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729031552 00000100:00100000:1.0:1784405056.900153:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784405056.900163:0:23457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729031552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784405056.900222:0:23457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784405056.900282:0:23457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729031552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405056.900289:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784405056.900492:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729031552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784405056.910163:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729031680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784405056.910275:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405056.910613:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729031680 00000100:00100000:3.0:1784405056.910621:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729031680 00000100:00100000:3.0:1784405056.910680:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784405056.910691:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729031680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784405056.910729:0:22722:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1784405056.910793:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729031680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405056.910800:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784405056.910972:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729031680:0@lo:41:osp-pre-0-1.0 00000020:01000004:0.0:1784405057.421890:0:24218:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784405057.421894:0:24218:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1784405057.421895:0:24218:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1784405057.422008:0:24218:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9dd573843800 00000020:01000004:0.0:1784405057.422025:0:24218:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1784405057.422039:0:24218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784405057.422054:0:24218:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9dd5445fcd40) 00000020:00000080:0.0:1784405057.422071:0:24218:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1784405057.541685:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1784405057.545286:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784405057.548453:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1784405057.549433:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1784405057.549870:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1784405057.550290:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1784405057.550554:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1784405057.551187:0:24218:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1784405057.568039:0:24218:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784405057.568395:0:24218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1784405057.568572:0:24218:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784405057.568585:0:24218:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x24b3e2e6dcd7a934 00000020:01000004:1.0:1784405057.568593:0:24218:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1784405057.568614:0:24218:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.142@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1784405057.568618:0:24218:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1784405057.568625:0:24218:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1784405057.568630:0:24218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1784405057.568643:0:24218:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9dd57d7219c0) 00000020:00000080:1.0:1784405057.568654:0:24218:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1784405057.572237:0:24218:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784405057.572438:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1784405057.572445:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1784405057.573968:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1784405057.573980:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1784405057.586127:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1784405057.586150:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1784405057.590829:0:24218:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784405057.591064:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1784405057.591071:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1784405057.592089:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1784405057.592097:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1784405057.615086:0:24218:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784405057.615809:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1784405057.615817:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1784405057.618035:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784405057.618047:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1784405057.619006:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1784405057.619016:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1784405057.625790:0:24218:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784405057.626185:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1784405057.626191:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1784405057.630441:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1784405057.630462:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1784405057.689540:0:24218:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784405057.690215:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1784405057.690222:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1784405057.692747:0:24218:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1784405057.692761:0:24218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1784405057.693715:0:24218:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1784405057.693746:0:24218:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1784405057.693753:0:24218:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1784405057.726713:0:24218:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784405057.726761:0:24218:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.142@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1784405057.726766:0:24218:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784405057.726768:0:24218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784405057.726769:0:24218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784405057.726770:0:24218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784405057.726772:0:24218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784405057.726779:0:24218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784405057.726780:0:24218:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784405057.726782:0:24218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784405057.726783:0:24218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784405057.726787:0:24218:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1784405057.726789:0:24218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784405057.726790:0:24218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784405057.726791:0:24218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784405057.726792:0:24218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784405057.726793:0:24218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784405057.726794:0:24218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784405057.726795:0:24218:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784405057.726796:0:24218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784405057.726797:0:24218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784405057.726823:0:24218:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1784405057.726845:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729031808:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784405057.727118:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405057.727213:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56ce8e240 going to sleep for 11 seconds 00000100:00100000:2.0:1784405057.736298:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729031808 00000100:00100000:2.0:1784405057.736316:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729031808 00000100:00100000:2.0:1784405057.736435:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784405057.736448:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:24218:x1871083729031808:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784405057.736519:0:22712:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1784405057.736524:0:22712:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1784405057.736528:0:22712:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1784405057.740565:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:24218:x1871083729031808:12345-0@lo:253:mount.lustre.0 Request processed in 4097us (13424us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405057.740584:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784405057.740700:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729031808:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784405057.740716:0:24218:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1784405057.740719:0:24218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784405057.740721:0:24218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784405057.740722:0:24218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784405057.740724:0:24218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784405057.740725:0:24218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784405057.740726:0:24218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784405057.740728:0:24218:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784405057.740729:0:24218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784405057.740731:0:24218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784405057.740757:0:24218:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd573843800 from lustre-OST0000 10000000:01000000:0.0:1784405057.740790:0:24218:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1784405057.740793:0:24218:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784405057.740803:0:24218:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dd44213b380 local copy 00010000:00010000:0.0:1784405057.740817:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd7a6ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a6f6 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405057.741014:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729031936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784405057.741060:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405057.743288:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b8f840 going to sleep for 11 seconds 00000100:00100000:3.0:1784405057.746012:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729031936 00000100:00100000:3.0:1784405057.746026:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729031936 00000100:00100000:3.0:1784405057.746116:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784405057.746127:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:24218:x1871083729031936:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784405057.746361:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:24218:x1871083729031936:12345-0@lo:501:mount.lustre.0 Request processed in 236us (5300us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784405057.746369:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784405057.746484:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729031936:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1784405057.746507:0:24218:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1784405057.746554:0:24218:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1784405057.746563:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd7a6ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a6f6 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.746574:0:24218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd7a6ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a6f6 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784405057.746608:0:24218:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd573843800 10000000:01000000:0.0:1784405057.746613:0:24218:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784405057.746619:0:24218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784405057.746621:0:24218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784405057.746626:0:24218:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1784405057.746629:0:24218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784405057.746657:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7a942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.746666:0:24218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7a942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.746676:0:24218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7a942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405057.746697:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729032064:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784405057.746733:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405057.746779:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b8f840 going to sleep for 11 seconds 00000100:00100000:3.0:1784405057.747934:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729032064 00000100:00100000:3.0:1784405057.747944:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729032064 00000100:00100000:3.0:1784405057.747981:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784405057.747989:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+18:24218:x1871083729032064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784405057.748002:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784405057.748015:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd442057c00/0x24b3e2e6dcd7a949 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a942 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405057.748057:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd442057c00/0x24b3e2e6dcd7a949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a942 expref: 19 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405057.748067:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd442057c00/0x24b3e2e6dcd7a949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a942 expref: 19 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405057.748076:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442057c00, rc 0) 00000100:00100000:3.0:1784405057.748127:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+19:24218:x1871083729032064:12345-0@lo:101:mount.lustre.0 Request processed in 138us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405057.748133:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784405057.748368:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729032064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784405057.748386:0:24218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7a942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a949 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.748395:0:24218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7a942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a949 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784405057.750269:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1784405057.751384:0:24218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784405057.759801:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1784405057.760047:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1784405057.760069:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1784405057.760086:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1784405057.760103:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1784405057.760118:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1784405057.760133:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1784405057.760147:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1784405057.760160:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1784405057.760173:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1784405057.760187:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1784405057.760795:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1784405057.760837:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1784405057.760844:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1784405057.762153:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729032192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784405057.762239:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405057.762281:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b8fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784405057.762586:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729032192 00000100:00100000:3.0:1784405057.762594:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729032192 00000100:00100000:3.0:1784405057.762647:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784405057.762657:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+19:24218:x1871083729032192:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784405057.762829:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+19:24218:x1871083729032192:12345-0@lo:501:mount.lustre.0 Request processed in 172us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405057.762837:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784405057.763194:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729032192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784405057.763243:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729032320:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784405057.763306:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405057.763336:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b8fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784405057.763446:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729032320 00000100:00100000:1.0:1784405057.763452:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729032320 00000100:00100000:1.0:1784405057.763489:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784405057.763496:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+19:24218:x1871083729032320:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784405057.764442:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+19:24218:x1871083729032320:12345-0@lo:503:mount.lustre.0 Request processed in 943us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405057.764452:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784405057.764561:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729032320:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784405057.765152:0:24218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784405057.765293:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729032448:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784405057.765346:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405057.765444:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b8f840 going to sleep for 11 seconds 00000100:00100000:2.0:1784405057.769289:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729032448 00000100:00100000:2.0:1784405057.769304:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729032448 00000100:00100000:2.0:1784405057.769407:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784405057.769419:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+19:24218:x1871083729032448:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784405057.774284:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+19:24218:x1871083729032448:12345-0@lo:502:mount.lustre.0 Request processed in 4858us (8928us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405057.774317:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784405057.774485:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729032448:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784405057.774808:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1784405057.774839:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1784405057.774887:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1784405057.774905:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1784405057.774920:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1784405057.774935:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1784405057.774949:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1784405057.774963:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1784405057.774978:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1784405057.775005:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1784405057.775018:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1784405057.775030:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1784405057.775069:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729032576:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784405057.775123:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405057.785808:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729032576 00000100:00100000:0.0:1784405057.785824:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729032576 00000100:00100000:3.0:1784405057.786005:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd56ce8eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784405057.789244:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784405057.789260:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+19:24218:x1871083729032576:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784405057.789461:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+19:24218:x1871083729032576:12345-0@lo:502:mount.lustre.0 Request processed in 203us (14337us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405057.789470:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784405057.789689:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729032576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784405057.789775:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1784405057.789788:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1784405057.791045:0:24235:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784405057.791054:0:24235:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1784405057.791064:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784405057.791066:0:24235:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1784405057.791072:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784405057.791090:0:24235:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9dd4430a0000) 00000020:00000080:2.0:1784405057.791117:0:24235:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1784405057.791124:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784405057.791233:0:24235:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd573843800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1784405057.791244:0:24235:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784405057.791254:0:24235:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x24b3e2e6dcd7a957 00010000:00010000:3.0:1784405057.802270:0:24235:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1784405057.802929:0:24235:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1784405057.804928:0:24235:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1784405057.814285:0:24235:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1784405057.814299:0:24235:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784405057.814306:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405057.814308:0:24235:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1784405057.814311:0:24235:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784405057.814314:0:24235:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1784405057.814315:0:24235:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784405057.814317:0:24235:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784405057.814318:0:24235:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784405057.814320:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405057.814321:0:24235:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784405057.814323:0:24235:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784405057.814326:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405057.814327:0:24235:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784405057.814329:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784405057.814331:0:24235:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784405057.814333:0:24235:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784405057.814335:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405057.814336:0:24235:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1784405057.814338:0:24235:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784405057.814340:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405057.814341:0:24235:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784405057.814344:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1784405057.814373:0:24235:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784405057.814376:0:24235:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405057.814377:0:24235:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784405057.814379:0:24235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1784405057.815240:0:24218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1784405057.815278:0:24218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784405057.815305:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7a942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a949 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405057.815320:0:24218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd443548800/0x24b3e2e6dcd7a942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a949 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784405057.815329:0:24218:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd573843800 from 1 10000000:01000000:3.0:1784405057.815332:0:24218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784405057.815369:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056a00/0x24b3e2e6dcd7a95e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405057.815377:0:24218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd442056a00/0x24b3e2e6dcd7a95e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405057.815388:0:24218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd442056a00/0x24b3e2e6dcd7a95e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405057.815418:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729032704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784405057.815484:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405057.815537:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd570601a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784405057.815745:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729032704 00000100:00100000:0.0:1784405057.815753:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729032704 00000100:00100000:0.0:1784405057.815802:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784405057.815812:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+19:24218:x1871083729032704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784405057.815825:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405057.815839:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a965 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a95e expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.815883:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a95e expref: 20 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.815895:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a95e expref: 20 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.815914:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd443549e00, rc 0) 00000100:00100000:0.0:1784405057.815957:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+20:24218:x1871083729032704:12345-0@lo:101:mount.lustre.0 Request processed in 146us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405057.815965:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784405057.816100:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729032704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784405057.816114:0:24218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd442056a00/0x24b3e2e6dcd7a95e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a965 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405057.816123:0:24218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd442056a00/0x24b3e2e6dcd7a95e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a965 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784405057.817669:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1784405057.823444:0:24218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784405057.824498:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1784405057.825378:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1784405057.825425:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1784405057.825442:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1784405057.825477:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1784405057.825494:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1784405057.825518:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1784405057.825533:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1784405057.826341:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1784405057.826372:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1784405057.826389:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1784405057.826415:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1784405057.826421:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1784405057.826555:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729032832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784405057.826629:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405057.826676:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443c13d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784405057.827099:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729032832 00000100:00100000:1.0:1784405057.827108:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729032832 00000100:00100000:1.0:1784405057.827161:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784405057.827181:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+20:24218:x1871083729032832:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784405057.827307:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+20:24218:x1871083729032832:12345-0@lo:501:mount.lustre.0 Request processed in 129us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405057.827315:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784405057.827918:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729032832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784405057.827970:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729032960:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784405057.828017:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405057.828101:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443c13d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784405057.833428:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729032960 00000100:00100000:0.0:1784405057.833443:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729032960 00000100:00100000:0.0:1784405057.833558:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784405057.833569:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+20:24218:x1871083729032960:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784405057.833744:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+20:24218:x1871083729032960:12345-0@lo:503:mount.lustre.0 Request processed in 177us (5725us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405057.833752:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784405057.833848:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729032960:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784405057.834325:0:24218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784405057.834402:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729033088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784405057.834449:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405057.835884:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd570601a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784405057.847737:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729033088 00000100:00100000:2.0:1784405057.847759:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729033088 00000100:00100000:2.0:1784405057.847877:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784405057.847888:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+20:24218:x1871083729033088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784405057.848069:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+20:24218:x1871083729033088:12345-0@lo:502:mount.lustre.0 Request processed in 183us (13619us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405057.848077:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784405057.849682:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729033088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784405057.849956:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1784405057.859986:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1784405057.860043:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1784405057.860060:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1784405057.860074:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1784405057.860087:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1784405057.860101:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1784405057.860116:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1784405057.860130:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1784405057.860142:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1784405057.860154:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1784405057.861318:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729033216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784405057.861428:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405057.861538:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443c13480 going to sleep for 11 seconds 00000100:00100000:0.0:1784405057.867082:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729033216 00000100:00100000:0.0:1784405057.867096:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729033216 00000100:00100000:0.0:1784405057.867170:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784405057.867194:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+20:24218:x1871083729033216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784405057.867944:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+20:24218:x1871083729033216:12345-0@lo:502:mount.lustre.0 Request processed in 752us (6514us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405057.867952:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784405057.870833:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729033216:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784405057.870963:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1784405057.870980:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1784405057.873434:0:24239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784405057.873446:0:24239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405057.873449:0:24239:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784405057.873455:0:24239:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd573843800 00000020:00000080:1.0:1784405057.873458:0:24239:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784405057.873466:0:24239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784405057.873468:0:24239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405057.873470:0:24239:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1784405057.873472:0:24239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784405057.873475:0:24239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405057.873476:0:24239:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784405057.873479:0:24239:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd573843800 00000020:00000080:1.0:1784405057.873480:0:24239:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784405057.873561:0:24239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784405057.873565:0:24239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405057.873566:0:24239:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1784405057.873569:0:24239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784405057.873572:0:24239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405057.873573:0:24239:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784405057.873577:0:24239:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd573843800 00000020:00000080:1.0:1784405057.873579:0:24239:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784405057.873598:0:24239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784405057.873601:0:24239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405057.873602:0:24239:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784405057.873604:0:24239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784405057.873607:0:24239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405057.873608:0:24239:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1784405057.873611:0:24239:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd573843800 00000020:00000080:1.0:1784405057.873619:0:24239:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784405057.873643:0:24239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784405057.873647:0:24239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784405057.873648:0:24239:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1784405057.873651:0:24239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1784405057.873881:0:24218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1784405057.873910:0:24218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784405057.873938:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056a00/0x24b3e2e6dcd7a95e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a965 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405057.873952:0:24218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd442056a00/0x24b3e2e6dcd7a95e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a965 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784405057.874038:0:24218:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784405057.874042:0:24218:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd573843800 10000000:01000000:3.0:1784405057.874045:0:24218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd573843800 10000000:01000000:3.0:1784405057.874049:0:24218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784405057.874054:0:24218:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd573843800 from 1 10000000:01000000:3.0:1784405057.874057:0:24218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784405057.874087:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056200/0x24b3e2e6dcd7a96c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405057.874096:0:24218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd442056200/0x24b3e2e6dcd7a96c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405057.874107:0:24218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd442056200/0x24b3e2e6dcd7a96c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405057.874131:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729033344:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784405057.874197:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405057.874235:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd570601e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784405057.877603:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729033344 00000100:00100000:1.0:1784405057.877620:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729033344 00000100:00100000:1.0:1784405057.877679:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784405057.877689:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+20:24218:x1871083729033344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784405057.877707:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784405057.877726:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd57331da00/0x24b3e2e6dcd7a973 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a96c expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405057.877755:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd57331da00/0x24b3e2e6dcd7a973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a96c expref: 21 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405057.877766:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd57331da00/0x24b3e2e6dcd7a973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a96c expref: 21 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405057.877777:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331da00, rc 0) 00000100:00100000:1.0:1784405057.877875:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:24218:x1871083729033344:12345-0@lo:101:mount.lustre.0 Request processed in 187us (3677us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405057.877882:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784405057.878028:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729033344:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784405057.878047:0:24218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd442056200/0x24b3e2e6dcd7a96c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a973 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405057.878057:0:24218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd442056200/0x24b3e2e6dcd7a96c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a973 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784405057.893498:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1784405057.893833:0:24218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784405057.894937:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1784405057.894975:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1784405057.895070:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1784405057.895089:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1784405057.895121:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1784405057.895138:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1784405057.895152:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1784405057.895164:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1784405057.895177:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1784405057.895191:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1784405057.895280:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1784405057.895297:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1784405057.895312:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1784405057.895326:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1784405057.895346:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1784405057.895361:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1784405057.895375:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1784405057.895389:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1784405057.895403:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1784405057.895417:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1784405057.895447:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1784405057.895464:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1784405057.895478:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1784405057.895491:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1784405057.895506:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1784405057.895535:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1784405057.895549:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1784405057.895561:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1784405057.895574:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1784405057.895589:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1784405057.895603:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1784405057.895615:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1784405057.895641:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1784405057.895655:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1784405057.895669:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1784405057.895684:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1784405057.895712:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1784405057.895729:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1784405057.895743:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1784405057.895757:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1784405057.895771:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1784405057.895785:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1784405057.895798:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1784405057.895813:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1784405057.895827:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1784405057.895839:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1784405057.896181:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1784405057.896214:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1784405057.896378:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1784405057.896399:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1784405057.896418:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1784405057.896424:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1784405057.896549:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729033472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784405057.896624:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405057.896671:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542aed0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784405057.896796:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729033472 00000100:00100000:0.0:1784405057.896805:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729033472 00000100:00100000:0.0:1784405057.896897:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784405057.896907:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:24218:x1871083729033472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784405057.897040:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:24218:x1871083729033472:12345-0@lo:501:mount.lustre.0 Request processed in 134us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405057.897048:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784405057.897273:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729033472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784405057.897309:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729033600:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784405057.897346:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405057.897375:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542aed0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784405057.900749:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729033600 00000100:00100000:0.0:1784405057.900766:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729033600 00000100:00100000:0.0:1784405057.900822:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784405057.900832:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:24218:x1871083729033600:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784405057.901022:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:24218:x1871083729033600:12345-0@lo:503:mount.lustre.0 Request processed in 191us (3675us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405057.901031:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784405057.901304:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729033600:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784405057.901762:0:24218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784405057.901892:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729033728:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784405057.901942:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405057.902327:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729033728 00000100:00100000:0.0:1784405057.902333:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729033728 00000100:00100000:0.0:1784405057.902370:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784405057.902378:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:24218:x1871083729033728:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784405057.902485:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:24218:x1871083729033728:12345-0@lo:502:mount.lustre.0 Request processed in 107us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405057.902492:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784405057.902559:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542aed0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784405057.902576:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729033728:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784405057.902768:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1784405057.902798:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1784405057.902813:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1784405057.902827:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1784405057.902841:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1784405057.902895:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1784405057.902912:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1784405057.902927:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1784405057.902941:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1784405057.902956:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1784405057.902971:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1784405057.905648:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1784405057.905774:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1784405057.905790:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1784405057.905824:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1784405057.905842:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1784405057.905885:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1784405057.905900:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1784405057.905914:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1784405057.905927:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1784405057.905940:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1784405057.905954:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1784405057.905968:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1784405057.906060:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1784405057.906082:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1784405057.906095:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1784405057.906107:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1784405057.906130:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1784405057.906145:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1784405057.906159:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1784405057.906185:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1784405057.906359:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1784405057.906378:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1784405057.906393:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1784405057.906407:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1784405057.906421:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1784405057.906433:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1784405057.906447:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1784405057.906460:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1784405057.906473:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1784405057.906487:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1784405057.906500:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1784405057.907318:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1784405057.907344:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1784405057.907356:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1784405057.907368:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1784405057.907394:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1784405057.907411:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1784405057.907470:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729033856:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784405057.907555:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405057.907601:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542aed0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784405057.908104:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729033856 00000100:00100000:0.0:1784405057.908112:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729033856 00000100:00100000:0.0:1784405057.908162:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784405057.908171:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:24218:x1871083729033856:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784405057.908442:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:24218:x1871083729033856:12345-0@lo:502:mount.lustre.0 Request processed in 271us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405057.908450:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784405057.909559:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729033856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784405057.909804:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1784405057.909832:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1784405057.909889:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729033984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784405057.909943:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405057.909972:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542aed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784405057.910379:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729033984 00000100:00100000:1.0:1784405057.910386:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729033984 00000100:00100000:1.0:1784405057.910426:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784405057.910434:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:24218:x1871083729033984:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784405057.910578:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:24218:x1871083729033984:12345-0@lo:502:mount.lustre.0 Request processed in 144us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405057.910593:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784405057.913711:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729033984:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784405057.913805:0:24218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1784405057.913819:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1784405057.914911:0:24245:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1784405057.914933:0:24245:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9dd57d724d40) 00000020:00000080:1.0:1784405057.914958:0:24245:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1784405057.918600:0:24245:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd573843800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784405057.918613:0:24245:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd573843800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784405057.918616:0:24245:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd573843800 3 00010000:00080000:1.0:1784405057.918653:0:24245:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd442040800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.142@tcp at head 00010000:00010000:1.0:1784405057.924528:0:24245:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1784405057.924643:0:24245:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1784405057.924688:0:24245:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784405057.924701:0:24245:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x24b3e2e6dcd7a981 00000100:00080000:1.0:1784405057.924711:0:24245:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784405057.924716:0:24245:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dd442040800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784405057.924751:0:24245:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd574d34a80 x1871083729034112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784405057.924782:0:24245:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784405057.924997:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1871083729034112:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784405057.925070:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405057.925135:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729034112 00000100:00100000:3.0:1784405057.925142:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729034112 00000100:00100000:3.0:1784405057.925171:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784405057.925179:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1871083729034112:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1784405057.925322:0:22717:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 675 last 0 00000020:00000080:3.0:1784405057.925357:0:22717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x24b3e2e6dcd7a988 00000004:00100000:3.0:1784405057.925374:0:22717:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784405057.925405:0:22717:0:(import.c:65:import_set_state_nolock()) ffff9dd4410d8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784405057.925460:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1871083729034112:12345-0@lo:38:llog_process_th.0 Request processed in 280us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405057.925467:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1784405057.925506:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd574d34a80 x1871083729034112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784405067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405057.925525:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784405057.925534:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1784405057.925541:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784405057.925545:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784405057.925547:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd442040800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784405057.925553:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1871083729034112:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1784405057.925686:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784405057.925691:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784405057.925694:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784405057.925697:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784405057.925723:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784405057.925726:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784405057.925729:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784405057.925732:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784405057.925757:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729034496:0@lo:400:kworker.0 00000100:00100000:2.0:1784405057.925790:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405057.925811:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784405057.925816:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083729034624:0@lo:400:kworker.0 00000100:00100000:2.0:1784405057.925836:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405057.925887:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729034496 00000100:00100000:2.0:1784405057.925891:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729034496 00000100:00100000:2.0:1784405057.925921:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784405057.925928:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729034496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405057.925963:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729034496:12345-0@lo:400:kworker.0 Request processed in 35us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405057.925968:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784405057.926279:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729034624 00000100:00100000:2.0:1784405057.926289:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729034624 00000100:00100000:2.0:1784405057.926317:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784405057.926322:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083729034624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405057.926356:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083729034624:12345-0@lo:400:kworker.0 Request processed in 34us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405057.926362:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1784405057.926392:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd5732bb100 x1871083729034624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784405057.926402:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083729034624:0@lo:400:kworker.0 00000100:00100000:2.0:1784405057.926412:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729034496:0@lo:400:kworker.0 00000100:00100000:3.0:1784405057.926496:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729034240:0@lo:400:kworker.0 00000100:00100000:3.0:1784405057.926534:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405057.926552:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784405057.926558:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083729034368:0@lo:400:kworker.0 00000100:00100000:3.0:1784405057.926579:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405057.926610:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729034368 00000100:00100000:3.0:1784405057.926614:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729034368 00000100:00100000:3.0:1784405057.926643:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784405057.926649:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083729034368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405057.926683:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083729034368:12345-0@lo:400:kworker.0 Request processed in 34us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405057.926689:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1784405057.926712:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd5732b9180 x1871083729034368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405057.926721:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083729034368:0@lo:400:kworker.0 00000020:01000004:1.0:1784405057.926887:0:24245:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1784405057.926901:0:24245:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9dd57d720000) 00000020:00000080:1.0:1784405057.926920:0:24245:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000100:00100000:2.0:1784405057.928341:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729034240 00000100:00100000:2.0:1784405057.928350:0:23457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729034240 00000100:00100000:2.0:1784405057.928392:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784405057.928401:0:23457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729034240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405057.928484:0:23457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729034240:12345-0@lo:400:kworker.0 Request processed in 84us (1948us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405057.928491:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784405057.928541:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729034240:0@lo:400:kworker.0 00000020:01000004:1.0:1784405057.929072:0:24245:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd573843800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784405057.929090:0:24245:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd573843800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784405057.929094:0:24245:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd573843800 3 00010000:00080000:1.0:1784405057.929125:0:24245:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd574d7b800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.142@tcp at head 00010000:00010000:1.0:1784405057.935155:0:24245:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1784405057.935455:0:24245:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1784405057.935504:0:24245:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784405057.935528:0:24245:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x24b3e2e6dcd7a996 00000100:00080000:1.0:1784405057.935545:0:24245:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784405057.935552:0:24245:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9dd574d7b800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784405057.935591:0:24245:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd574d35f80 x1871083729034752/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784405057.935659:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1871083729034752:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784405057.935747:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405057.935832:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729034752 00000100:00100000:2.0:1784405057.935841:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729034752 00000100:00100000:2.0:1784405057.935893:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784405057.935900:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1871083729034752:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1784405057.935925:0:22717:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 675 last 0 00000020:00000080:2.0:1784405057.935955:0:22717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x24b3e2e6dcd7a99d 00000004:00100000:2.0:1784405057.935969:0:22717:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784405057.936018:0:22717:0:(import.c:65:import_set_state_nolock()) ffff9dd443145800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1784405057.937733:0:24245:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1784405057.938089:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784405057.938096:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784405057.938099:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784405057.938103:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784405057.938117:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784405057.938120:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784405057.938123:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784405057.938126:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1784405057.938310:0:24245:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1784405057.938913:0:24218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1784405057.938957:0:24218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784405057.938979:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056200/0x24b3e2e6dcd7a96c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a973 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.939002:0:24218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd442056200/0x24b3e2e6dcd7a96c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a973 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784405057.939053:0:24218:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784405057.939055:0:24218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784405057.939057:0:24218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784405057.939058:0:24218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784405057.939059:0:24218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784405057.939060:0:24218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784405057.939062:0:24218:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784405057.939063:0:24218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784405057.939065:0:24218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784405057.939069:0:24218:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1784405057.939071:0:24218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784405057.939073:0:24218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784405057.939074:0:24218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784405057.939075:0:24218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784405057.939076:0:24218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784405057.939077:0:24218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784405057.939078:0:24218:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784405057.939079:0:24218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784405057.939080:0:24218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784405057.939105:0:24218:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1784405057.939124:0:24218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729034880:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784405057.939189:0:24218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405057.939324:0:24218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd542e77600 going to sleep for 11 seconds 00000100:00100000:0.0:1784405057.939344:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729034880 00000100:00100000:0.0:1784405057.939350:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729034880 00000100:00100000:0.0:1784405057.939391:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784405057.939399:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:24218:x1871083729034880:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784405057.939425:0:22711:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784405057.939438:0:22711:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1784405057.941189:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dd574d35f80 x1871083729034752/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784405067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405057.941263:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784405057.941273:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1784405057.941281:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784405057.941286:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784405057.941290:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784405057.941296:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1871083729034752:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1784405057.941925:0:22711:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784405057.941941:0:22711:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1784405057.942348:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:24218:x1871083729034880:12345-0@lo:253:mount.lustre.0 Request processed in 2946us (3156us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405057.942359:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 20000000:01000000:3.0:1784405057.942446:0:22733:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784405057.942452:0:22733:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784405057.942473:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a9a4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405057.942490:0:22733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd443549600/0x24b3e2e6dcd7a8ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a8e7 expref: 20 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405057.942520:0:22733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd443549c00/0x24b3e2e6dcd7a8fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a8f5 expref: 20 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405057.942528:0:22733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a9a4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405057.942563:0:22733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd443549c00/0x24b3e2e6dcd7a8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8f5 expref: 20 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405057.942577:0:22733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd443549c00/0x24b3e2e6dcd7a8fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8f5 expref: 20 pid: 22710 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405057.942590:0:22733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22733:1871083729035008:0@lo:104: 00000100:00100000:3.0:1784405057.942626:0:22733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784405057.942665:0:22733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd443549600/0x24b3e2e6dcd7a8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8e7 expref: 20 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405057.942673:0:22733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd443549600/0x24b3e2e6dcd7a8ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8e7 expref: 20 pid: 22712 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405057.942680:0:22733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22733:1871083729035136:0@lo:104: 00000100:00100000:3.0:1784405057.942703:0:22733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405057.942793:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1871083729034752:12345-0@lo:38:llog_process_th.0 Request processed in 6890us (7044us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405057.942802:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784405057.942871:0:22733:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd570601180 going to sleep for 11 seconds 00000100:00100000:0.0:1784405057.943648:0:24218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:24218:1871083729034880:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784405057.943661:0:24218:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1784405057.943663:0:24218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784405057.943665:0:24218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784405057.943667:0:24218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784405057.943668:0:24218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784405057.943669:0:24218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784405057.943670:0:24218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784405057.943672:0:24218:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784405057.943673:0:24218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784405057.943675:0:24218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784405057.943689:0:24218:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1784405057.944871:0:22700:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784405057.944898:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729035008 00000100:00100000:1.0:1784405057.944906:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729035008 00000100:00100000:1.0:1784405057.944938:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729035136 00000100:00100000:1.0:1784405057.944941:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729035136 00000100:00100000:1.0:1784405057.944957:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784405057.944967:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+4:22733:x1871083729035008:12345-0@lo:104: 00010000:00010000:1.0:1784405057.945094:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd57331c000/0x24b3e2e6dcd7a8f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a8fc expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1784405057.948293:0:24218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:0.0:1784405057.948722:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784405057.948735:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+4:22733:x1871083729035008:12345-0@lo:104: Request processed in 3765us (6104us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405057.948745:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784405057.948776:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784405057.948787:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c91fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+3:22733:x1871083729035136:12345-0@lo:104: 00010000:00010000:0.0:1784405057.948804:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd57331d800/0x24b3e2e6dcd7a8e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a8ee expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.948840:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784405057.948867:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c91fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+3:22733:x1871083729035136:12345-0@lo:104: Request processed in 83us (6162us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405057.948874:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784405057.948938:0:22733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22733:1871083729035008:0@lo:104: 00000100:00100000:0.0:1784405057.948949:0:22733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22733:1871083729035136:0@lo:104: 00010000:00010000:0.0:1784405057.948970:0:22733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a9a4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949003:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784405057.949009:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd57331c000/0x24b3e2e6dcd7a8f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a8fc expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949017:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331c000 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784405057.949021:0:22706:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd57331c000/0x24b3e2e6dcd7a8f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a8fc expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949031:0:22706:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd57331c000/0x24b3e2e6dcd7a8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a8fc expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784405057.949039:0:22706:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd57331c000/0x24b3e2e6dcd7a8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a8fc expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784405057.949046:0:22706:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784405057.949083:0:22706:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd57331c000/0x24b3e2e6dcd7a8f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a8fc expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949090:0:22706:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784405057.949112:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd57331c000/0x24b3e2e6dcd7a8f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a8fc expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949130:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd57331c000/0x24b3e2e6dcd7a8f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a8fc expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949141:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784405057.949144:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd57331d800/0x24b3e2e6dcd7a8e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a8ee expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949149:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331d800 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784405057.949152:0:22706:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd57331d800/0x24b3e2e6dcd7a8e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a8ee expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949159:0:22706:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd57331d800/0x24b3e2e6dcd7a8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a8ee expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784405057.949165:0:22706:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd57331d800/0x24b3e2e6dcd7a8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a8ee expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784405057.949170:0:22706:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784405057.949185:0:22706:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd57331d800/0x24b3e2e6dcd7a8e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a8ee expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949191:0:22706:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784405057.949321:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd57331d800/0x24b3e2e6dcd7a8e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a8ee expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949329:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd57331d800/0x24b3e2e6dcd7a8e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a8ee expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949342:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405057.949350:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405057.949352:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405057.949359:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784405057.949379:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3649:1871083729035392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784405057.949420:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405057.949458:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784405057.949464:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3649:1871083729035264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784405057.949488:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405057.949528:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729035392 00000100:00100000:0.0:1784405057.949535:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729035392 00010000:00010000:0.0:1784405057.949557:0:22704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd443549600/0x24b3e2e6dcd7a8ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8e7 expref: 21 pid: 22712 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405057.949581:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729035264 00000100:00100000:0.0:1784405057.949584:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729035264 00010000:00010000:0.0:1784405057.949597:0:22704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd443549c00/0x24b3e2e6dcd7a8fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8f5 expref: 22 pid: 22710 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405057.949610:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784405057.949617:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443631180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+22:3649:x1871083729035392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784405057.949627:0:22704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784405057.949633:0:22704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd443549600/0x24b3e2e6dcd7a8ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8e7 expref: 22 pid: 22712 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949643:0:22704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd443549600/0x24b3e2e6dcd7a8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8e7 expref: 22 pid: 22712 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949658:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443549600/0x24b3e2e6dcd7a8ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8e7 expref: 22 pid: 22712 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949680:0:22704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784405057.949708:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443631180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:3649:x1871083729035392:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405057.949715:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784405057.949730:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784405057.949736:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57cedc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+20:3649:x1871083729035264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784405057.949744:0:22704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784405057.949748:0:22704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd443549c00/0x24b3e2e6dcd7a8fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8f5 expref: 20 pid: 22710 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949757:0:22704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd443549c00/0x24b3e2e6dcd7a8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8f5 expref: 20 pid: 22710 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949766:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443549c00/0x24b3e2e6dcd7a8fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a8f5 expref: 20 pid: 22710 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949776:0:22704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a9a4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949783:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a9a4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784405057.949795:0:22704:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007351143s 00010000:00010000:0.0:1784405057.949799:0:22704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a9a4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949806:0:22704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a9a4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949822:0:22704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a9a4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949829:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a9a4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949835:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057e00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784405057.949838:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a9a4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949846:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a9a4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949889:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a9a4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.949900:0:22704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784405057.949926:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57cedc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+19:3649:x1871083729035264:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405057.949933:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1784405057.950917:0:22733:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a9a4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.950929:0:22733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a9a4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405057.950935:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd442057e00/0x24b3e2e6dcd7a9a4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405057.950976:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3649:1871083729035264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784405057.951913:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3649:1871083729035392:0@lo:103:ldlm_bl.0 00002000:00080000:2.0:1784405057.954337:0:24218:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1784405057.954345:0:24218:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1784405057.954384:0:24218:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784405057.954426:0:24218:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784405057.954443:0:24218:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1784405057.954462:0:24218:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1784405057.955337:0:24218:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784405057.955579:0:24218:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784405058.571744:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784405058.817799:0:24297:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784405058.819407:0:24297:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1784405059.587024:0:22714:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784405059.587033:0:22714:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd54851a800 from 13 10000000:01000000:0.0:1784405059.587039:0:22714:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784405059.587104:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a9ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405059.587116:0:22714:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a9ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405059.587127:0:22714:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a9ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405059.587155:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729035520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784405059.587226:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405059.587277:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5503d3540 going to sleep for 11 seconds 00000100:00100000:3.0:1784405059.587522:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729035520 00000100:00100000:3.0:1784405059.587530:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729035520 00000100:00100000:3.0:1784405059.587577:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784405059.587586:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+19:22714:x1871083729035520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784405059.587599:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784405059.587617:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a9b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a9ab expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405059.587643:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a9b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a9ab expref: 20 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405059.587654:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a9b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a9ab expref: 20 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405059.587664:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442057800, rc 0) 00000100:00100000:3.0:1784405059.587705:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+20:22714:x1871083729035520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405059.587712:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:3.0:1784405059.588900:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784405059.589471:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729035520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784405059.589503:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a9ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a9b2 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405059.589515:0:22714:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a9ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a9b2 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405059.589761:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729035648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784405059.589820:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405059.589944:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5503d3540 going to sleep for 11 seconds 00000100:00100000:1.0:1784405059.590038:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729035648 00000100:00100000:1.0:1784405059.590046:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729035648 00000100:00100000:1.0:1784405059.590184:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784405059.590195:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+20:22714:x1871083729035648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784405059.590215:0:22711:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784405059.590234:0:22711:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784405059.590237:0:22711:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1784405059.590336:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+20:22714:x1871083729035648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 142us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405059.590344:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784405059.590579:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729035648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784405059.590654:0:22714:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784405059.590662:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a9ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a9b2 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405059.590671:0:22714:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a9b2 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784405059.590679:0:22714:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784405059.590682:0:22714:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd442282800 from 13 10000000:01000000:0.0:1784405059.590684:0:22714:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784405059.590706:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443549c00/0x24b3e2e6dcd7a9b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405059.590713:0:22714:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd443549c00/0x24b3e2e6dcd7a9b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405059.590722:0:22714:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd443549c00/0x24b3e2e6dcd7a9b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405059.590736:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729035776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784405059.590760:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405059.591072:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5503d3540 going to sleep for 11 seconds 00000100:00100000:3.0:1784405059.591170:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729035776 00000100:00100000:3.0:1784405059.591176:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729035776 00000100:00100000:3.0:1784405059.591203:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784405059.591211:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+20:22714:x1871083729035776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784405059.591220:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784405059.591233:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd442056600/0x24b3e2e6dcd7a9c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7a9b9 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405059.591253:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd442056600/0x24b3e2e6dcd7a9c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a9b9 expref: 21 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405059.591263:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd442056600/0x24b3e2e6dcd7a9c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a9b9 expref: 21 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405059.591271:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442056600, rc 0) 00000100:00100000:3.0:1784405059.591377:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:22714:x1871083729035776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405059.591389:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784405059.591548:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729035776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784405059.591562:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd443549c00/0x24b3e2e6dcd7a9b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a9c0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405059.591741:0:22714:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd443549c00/0x24b3e2e6dcd7a9b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7a9c0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405059.591795:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d37800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729035904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784405059.591827:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405059.591968:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd558d61000 going to sleep for 11 seconds 00000100:00100000:0.0:1784405059.592275:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729035904 00000100:00100000:0.0:1784405059.592281:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729035904 00000100:00100000:3.0:1784405059.592469:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784405059.592480:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:22714:x1871083729035904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784405059.592508:0:22712:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784405059.592524:0:22712:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784405059.592527:0:22712:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1784405059.592920:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:22714:x1871083729035904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 441us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405059.592928:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784405059.593013:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d37800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729035904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784405059.593145:0:22714:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784405059.593154:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443549c00/0x24b3e2e6dcd7a9b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a9c0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405059.593164:0:22714:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd443549c00/0x24b3e2e6dcd7a9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a9c0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784405059.907479:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784405060.619335:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405061.639794:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784405062.020669:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729036032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784405062.020801:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405062.020934:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784405062.020943:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729036160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784405062.021222:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405062.021277:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729036032 00000100:00100000:3.0:1784405062.021288:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729036032 00000100:00100000:3.0:1784405062.021343:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729036160 00000100:00100000:3.0:1784405062.021347:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729036160 00000100:00100000:3.0:1784405062.021369:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784405062.021379:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083729036032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784405062.021430:0:22722:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784405062.021505:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083729036032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405062.021513:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784405062.021540:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784405062.021561:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729036160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784405062.021586:0:22722:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1784405062.021632:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729036160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405062.021639:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784405062.021707:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729036160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784405062.021722:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729036032:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784405062.659060:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784405063.060066:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784405063.060073:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784405063.060076:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784405063.060080:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784405063.060107:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784405063.060111:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784405063.060114:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784405063.060117:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784405063.060169:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083729036544:0@lo:400:kworker.0 00000100:00100000:3.0:1784405063.060251:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405063.060283:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083729037056:0@lo:400:kworker.0 00000100:00100000:3.0:1784405063.060305:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405063.060327:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784405063.060332:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729036672:0@lo:400:kworker.0 00000100:00100000:3.0:1784405063.060354:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405063.060482:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729036544 00000100:00100000:3.0:1784405063.060490:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729036544 00000100:00100000:3.0:1784405063.060532:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729037056 00000100:00100000:3.0:1784405063.060536:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729037056 00000100:00100000:3.0:1784405063.060564:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784405063.060572:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083729036544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405063.060623:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083729036544:12345-0@lo:400:kworker.0 Request processed in 51us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405063.060630:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784405063.060647:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784405063.060653:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083729037056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405063.060693:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1871083729037056:12345-0@lo:400:kworker.0 Request processed in 40us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405063.060699:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784405063.060719:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729036672 00000100:00100000:3.0:1784405063.060722:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729036672 00000100:00100000:3.0:1784405063.060756:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784405063.060762:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729036672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405063.060795:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729036672:12345-0@lo:400:kworker.0 Request processed in 32us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405063.060801:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1784405063.060833:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784405063.060966:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729036672:0@lo:400:kworker.0 00010000:00080000:3.0:1784405063.060981:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd44242d880 x1871083729036544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405063.060992:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083729036544:0@lo:400:kworker.0 00010000:00080000:3.0:1784405063.061013:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd44242ce00 x1871083729037056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405063.061021:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1871083729037056:0@lo:400:kworker.0 00000100:00100000:0.0:1784405063.061254:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729036416:0@lo:400:kworker.0 00000100:00100000:0.0:1784405063.061285:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405063.061321:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083729036928:0@lo:400:kworker.0 00000100:00100000:0.0:1784405063.061355:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405063.061374:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784405063.061381:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3649:1871083729036288:0@lo:400:kworker.0 00000100:00100000:0.0:1784405063.061405:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405063.061424:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083729036800:0@lo:400:kworker.0 00000100:00100000:0.0:1784405063.061444:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405063.061490:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729036288 00000100:00100000:0.0:1784405063.061495:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729036288 00000100:00100000:0.0:1784405063.061526:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784405063.061533:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:3649:x1871083729036288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405063.061568:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:3649:x1871083729036288:12345-0@lo:400:kworker.0 Request processed in 36us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405063.061575:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784405063.061607:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3649:1871083729036288:0@lo:400:kworker.0 00000100:00100000:0.0:1784405063.061623:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729036928 00000100:00100000:0.0:1784405063.061627:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729036928 00000100:00100000:0.0:1784405063.061651:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729036800 00000100:00100000:0.0:1784405063.061654:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729036800 00000100:00100000:0.0:1784405063.061667:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784405063.061672:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083729036928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405063.061704:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083729036928:12345-0@lo:400:kworker.0 Request processed in 31us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405063.061711:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784405063.061721:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784405063.061740:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083729036800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405063.061766:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083729036800:12345-0@lo:400:kworker.0 Request processed in 39us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405063.061778:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1784405063.061803:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd44242e680 x1871083729036800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784405063.061813:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083729036800:0@lo:400:kworker.0 00010000:00080000:0.0:1784405063.061822:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd44242f100 x1871083729036928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784405063.061830:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083729036928:0@lo:400:kworker.0 00000100:00080000:0.0:1784405063.061847:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784405063.064928:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729036416 00000100:00100000:3.0:1784405063.064942:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729036416 00000100:00100000:3.0:1784405063.066185:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784405063.066203:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729036416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405063.068357:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729036416:12345-0@lo:400:kworker.0 Request processed in 2154us (7063us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405063.068372:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784405063.068619:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729036416:0@lo:400:kworker.0 00010000:00010000:2.0:1784405063.683005:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784405063.951263:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784405064.711675:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784405064.986293:0:24587:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784405065.734012:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784405066.118016:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784405051/real 1784405051] req@ffff9dd570590a80 x1871083729030016/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405066 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405066.118047:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd570590a80 x1871083729030016/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405066 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405066.118058:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784405051/real 1784405051] req@ffff9dd570591500 x1871083729030144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405066 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405066.118070:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd570591500 x1871083729030144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405066 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784405066.118090:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd443339000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784405066.118120:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784405066.118132:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729030016:0@lo:8:kworker.0 00000100:00080000:3.0:1784405066.118138:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784405066.118144:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784405066.118156:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729030144:0@lo:8:kworker.0 00000100:00080000:2.0:1784405066.118412:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784405066.118417:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784405066.118420:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784405066.118423:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784405066.118452:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784405066.118455:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784405066.118458:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd443339000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784405066.118464:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 669 00000100:00080000:2.0:1784405066.118469:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784405066.118476:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dd443339000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784405066.118497:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd5732b9c00 x1871083729037696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784405066.118522:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784405066.118524:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784405066.118526:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784405066.118529:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 669 00000100:00080000:2.0:1784405066.118532:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784405066.118535:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd574d7e800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784405066.118561:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd5732b8000 x1871083729037824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784405066.118605:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729037312:0@lo:400:kworker.0 00000100:00100000:2.0:1784405066.118669:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405066.118707:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083729038080:0@lo:400:kworker.0 00000100:00100000:2.0:1784405066.118737:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405066.118767:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784405066.118773:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083729037440:0@lo:400:kworker.0 00000100:00100000:2.0:1784405066.118794:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405066.118809:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083729038208:0@lo:400:kworker.0 00000100:00100000:2.0:1784405066.118828:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405066.119245:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729038080 00000100:00100000:0.0:1784405066.119254:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729038080 00000100:00100000:0.0:1784405066.119312:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729037440 00000100:00100000:0.0:1784405066.119316:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729037440 00000100:00100000:0.0:1784405066.119327:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729038208 00000100:00100000:0.0:1784405066.119329:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729038208 00000100:00100000:0.0:1784405066.119357:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784405066.119366:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083729038080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405066.119428:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083729038080:12345-0@lo:400:kworker.0 Request processed in 63us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405066.119469:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784405066.119487:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784405066.119493:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083729037440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405066.119521:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083729037440:12345-0@lo:400:kworker.0 Request processed in 28us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405066.119526:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784405066.119562:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784405066.119569:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083729038208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405066.119599:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083729038208:12345-0@lo:400:kworker.0 Request processed in 31us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405066.119605:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1784405066.119644:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd5732b8700 x1871083729037440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784405066.119655:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083729037440:0@lo:400:kworker.0 00010000:00080000:0.0:1784405066.119669:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd5732bbb80 x1871083729038208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784405066.119676:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083729038208:0@lo:400:kworker.0 00010000:00080000:0.0:1784405066.119684:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd5732b9880 x1871083729038080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784405066.119692:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083729038080:0@lo:400:kworker.0 00000100:00100000:3.0:1784405066.120669:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3647:1871083729037184:0@lo:400:kworker.0 00000100:00100000:3.0:1784405066.120729:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405066.120775:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083729037952:0@lo:400:kworker.0 00000100:00100000:3.0:1784405066.120800:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405066.120825:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784405066.120833:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729037568:0@lo:400:kworker.0 00000100:00100000:3.0:1784405066.120878:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405066.120916:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729037312 00000100:00100000:3.0:1784405066.120923:0:23457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729037312 00000100:00100000:3.0:1784405066.120960:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729037568 00000100:00100000:3.0:1784405066.120963:0:23457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729037568 00000100:00100000:3.0:1784405066.120980:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784405066.120987:0:23457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729037312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405066.121042:0:23457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729037312:12345-0@lo:400:kworker.0 Request processed in 55us (2372us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405066.121048:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784405066.121066:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784405066.121071:0:23457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729037568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405066.121117:0:23457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729037568:12345-0@lo:400:kworker.0 Request processed in 45us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405066.121133:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784405066.121153:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729037184 00000100:00100000:3.0:1784405066.121157:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729037184 00000100:00100000:3.0:1784405066.121185:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784405066.121193:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:3647:x1871083729037184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405066.121233:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:3647:x1871083729037184:12345-0@lo:400:kworker.0 Request processed in 41us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405066.121239:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784405066.121268:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729037952 00000100:00100000:3.0:1784405066.121272:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729037952 00000100:00100000:3.0:1784405066.121298:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784405066.121305:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083729037952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405066.121335:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083729037952:12345-0@lo:400:kworker.0 Request processed in 30us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405066.121353:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784405066.121406:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729037312:0@lo:400:kworker.0 00000100:00100000:3.0:1784405066.121448:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729037696:0@lo:8:kworker.0 00000100:00100000:3.0:1784405066.121481:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405066.121502:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729037824:0@lo:8:kworker.0 00000100:00100000:3.0:1784405066.121530:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405066.121606:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729037696 00000100:00100000:3.0:1784405066.121610:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729037696 00000100:00100000:3.0:1784405066.121632:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729037824 00000100:00100000:3.0:1784405066.121635:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729037824 00000100:00100000:3.0:1784405066.121646:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784405066.121650:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1871083729037696:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1784405066.121676:0:24222:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 684 last 0 00000020:00000080:3.0:1784405066.121710:0:24222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd7a9c7 00002000:00100000:3.0:1784405066.121727:0:24222:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9dd4410df000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ae ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1784405066.121732:0:24222:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1784405066.121740:0:24222:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784405066.121963:0:24222:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1784405066.121987:0:24222:0:(import.c:65:import_set_state_nolock()) ffff9dd4410d9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784405066.122032:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1871083729037696:12345-0@lo:8:kworker.0 Request processed in 379us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405066.122038:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784405066.122053:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784405066.122057:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1871083729037824:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1784405066.122069:0:24222:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1784405066.124753:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784405066.124764:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:1.0:1784405066.124996:0:24640:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:2.0:1784405066.125296:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729037568:0@lo:400:kworker.0 00000100:00100000:2.0:1784405066.125310:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3647:1871083729037184:0@lo:400:kworker.0 00010000:00080000:2.0:1784405066.125324:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd5732ba300 x1871083729037952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784405066.125358:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083729037952:0@lo:400:kworker.0 00000020:00000004:1.0:1784405066.126003:0:24640:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:1.0:1784405066.129726:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd5732b9c00 x1871083729037696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784405086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405066.129742:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784405066.129755:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1784405066.129765:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784405066.129772:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784405066.129776:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd443339000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784405066.129801:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784405066.129807:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729037696:0@lo:8:kworker.0 00000004:00080000:0.0:1784405066.129952:0:23459:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1784405066.129978:0:23459:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23459:1871083729038464:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1784405066.130041:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405066.130071:0:23459:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435e3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784405066.130082:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784405066.130108:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729038336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784405066.130144:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405066.130178:0:24225:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1784405066.130184:0:24225:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1784405066.130207:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729038336 00000100:00100000:0.0:1784405066.130212:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729038336 00000100:00100000:0.0:1784405066.130269:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784405066.130278:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1871083729038336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784405066.130319:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1784405066.130373:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1871083729038336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405066.130380:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1784405066.130402:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784405066.130421:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd443632680 x1871083729038336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784405082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784405066.130449:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729038336:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1784405066.130926:0:23458:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784405066.131022:0:23458:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 684015169581ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784405066.131029:0:23458:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1784405066.142302:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729038464 00000100:00100000:2.0:1784405066.142315:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729038464 00000100:00100000:1.0:1784405066.143789:0:24642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784405066.143806:0:24642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23459:x1871083729038464:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1784405066.148053:0:23448:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1784405066.148736:0:24642:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1784405066.148743:0:24642:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1784405066.148918:0:24642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23459:x1871083729038464:12345-0@lo:7:osp-pre-0-1.0 Request processed in 5113us (18872us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405066.148930:0:24642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1784405066.158831:0:23459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd443630380 x1871083729038464/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784405082 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784405066.158876:0:23459:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23459:1871083729038464:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1784405066.158892:0:23459:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1784405066.160290:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1871083729037824:12345-0@lo:8:kworker.0 Request processed in 38225us (38753us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784405066.160307:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1784405066.161245:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784405066.161255:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784405066.161259:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729037824:0@lo:8:kworker.0 00000100:00100000:0.0:1784405066.162027:0:23459:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23459:1871083729038592:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1784405066.162081:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405066.162127:0:23459:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435e3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784405066.162229:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729038592 00000100:00100000:2.0:1784405066.162235:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729038592 00000100:00100000:2.0:1784405066.162291:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784405066.162301:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23459:x1871083729038592:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1784405066.162330:0:24225:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1784405066.162371:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23459:x1871083729038592:12345-0@lo:5:osp-pre-0-1.0 Request processed in 71us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405066.162379:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784405066.162513:0:23459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd443630380 x1871083729038592/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784405082 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784405066.162525:0:23459:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23459:1871083729038592:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1784405066.162535:0:23459:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1784405066.162662:0:23459:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443630380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23459:1871083729038720:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1784405066.162686:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405066.162712:0:23459:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4435e3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784405066.162753:0:24642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729038720 00000100:00100000:2.0:1784405066.162757:0:24642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729038720 00000100:00100000:2.0:1784405066.162788:0:24642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784405066.162795:0:24642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23459:x1871083729038720:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1784405066.162822:0:24642:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:2.0:1784405066.197806:0:24219:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1784405066.197821:0:24219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1784405066.201521:0:24642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23459:x1871083729038720:12345-0@lo:5:osp-pre-0-1.0 Request processed in 38715us (38822us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1784405066.201535:0:24642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1784405066.204656:0:23459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd443630380 x1871083729038720/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784405082 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405066.204673:0:23459:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1784405066.204681:0:23459:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443630380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23459:1871083729038720:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1784405066.204700:0:23459:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1784405066.204768:0:23459:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d36300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23459:1871083729038848:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1784405066.204833:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405066.204896:0:23459:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510a0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784405066.204934:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729038848 00000100:00100000:3.0:1784405066.204942:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729038848 00000100:00100000:3.0:1784405066.204997:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784405066.205007:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23459:x1871083729038848:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1784405066.205063:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23459:x1871083729038848:12345-0@lo:900:osp-pre-0-1.0 Request processed in 57us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405066.205070:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784405066.205704:0:23459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd574d36300 x1871083729038848/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784405082 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405066.205731:0:23459:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d36300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23459:1871083729038848:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1784405066.756206:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784405067.094266:0:24691:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784405067.094631:0:24691:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784405067.152084:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784405067.152107:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729039104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784405067.152200:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405067.153696:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729039104 00000100:00100000:3.0:1784405067.153709:0:23457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729039104 00000100:00100000:3.0:1784405067.153782:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784405067.153793:0:23457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729039104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784405067.153828:0:23457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1784405067.153919:0:23457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729039104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (1719us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405067.153926:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784405067.153976:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729039104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784405067.154833:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784405067.158774:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729038976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784405067.158876:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405067.160052:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729038976 00000100:00100000:2.0:1784405067.160064:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729038976 00000100:00100000:2.0:1784405067.160228:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784405067.160240:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083729038976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784405067.160279:0:22722:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784405067.161141:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083729038976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 899us (2286us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405067.161151:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784405067.188023:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729038976:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784405067.779080:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405068.803494:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784405069.123958:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784405069.831214:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405070.852077:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784405071.235172:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784405071.235191:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729039232:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784405071.235262:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405071.235355:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729039232 00000100:00100000:1.0:1784405071.235362:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729039232 00000100:00100000:1.0:1784405071.235697:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784405071.235708:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729039232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784405071.235754:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1784405071.235802:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729039232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405071.235810:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1784405071.235833:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784405071.235902:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd574d35c00 x1871083729039232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784405087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405071.235920:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729039232:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784405071.236700:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784405071.236704:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784405071.236706:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784405071.236709:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784405071.236738:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784405071.236742:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784405071.236747:0:37:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784405071.236754:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 684 00000100:00080000:2.0:1784405071.236759:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784405071.236764:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd574d7e800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784405071.236783:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd5732bb100 x1871083729039872/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784405071.236827:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3646:1871083729039360:0@lo:400:kworker.0 00000100:00100000:2.0:1784405071.237236:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405071.237271:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083729040000:0@lo:400:kworker.0 00000100:00100000:2.0:1784405071.237518:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405071.237540:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784405071.237546:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729039488:0@lo:400:kworker.0 00000100:00100000:2.0:1784405071.237567:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405071.237581:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083729040128:0@lo:400:kworker.0 00000100:00100000:2.0:1784405071.237597:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405071.237628:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729039360 00000100:00100000:2.0:1784405071.237633:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729039360 00000100:00100000:2.0:1784405071.237666:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784405071.237672:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:3646:x1871083729039360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405071.237713:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:3646:x1871083729039360:12345-0@lo:400:kworker.0 Request processed in 40us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405071.237720:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784405071.237806:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729040000 00000100:00100000:2.0:1784405071.237809:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729040000 00000100:00100000:2.0:1784405071.237830:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729040128 00000100:00100000:2.0:1784405071.237832:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729040128 00000100:00100000:2.0:1784405071.237869:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784405071.238031:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729039744:0@lo:400:kworker.0 00000100:00100000:0.0:1784405071.238058:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405071.238075:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784405071.238091:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083729039616:0@lo:400:kworker.0 00000100:00100000:0.0:1784405071.238110:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405071.238120:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083729040256:0@lo:400:kworker.0 00000100:00100000:0.0:1784405071.238135:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405071.238629:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083729040000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405071.238669:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083729040000:12345-0@lo:400:kworker.0 Request processed in 794us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405071.238676:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784405071.238691:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729039616 00000100:00100000:2.0:1784405071.238695:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729039616 00000100:00100000:2.0:1784405071.238709:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729040256 00000100:00100000:2.0:1784405071.238721:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729040256 00000100:00100000:1.0:1784405071.238880:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729039488 00000100:00100000:1.0:1784405071.238885:0:23457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729039488 00000100:00100000:1.0:1784405071.238910:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729039744 00000100:00100000:1.0:1784405071.238912:0:23457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729039744 00000100:00100000:1.0:1784405071.238923:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784405071.238928:0:23457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083729039488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405071.238961:0:23457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083729039488:12345-0@lo:400:kworker.0 Request processed in 32us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405071.238972:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784405071.238983:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784405071.238988:0:23457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729039744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405071.239015:0:23457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729039744:12345-0@lo:400:kworker.0 Request processed in 27us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405071.239020:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1784405071.239043:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784405071.239046:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784405071.239071:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729039744:0@lo:400:kworker.0 00000100:00100000:2.0:1784405071.239259:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784405071.239266:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083729040128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405071.239533:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1871083729040128:12345-0@lo:400:kworker.0 Request processed in 268us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405071.239539:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784405071.239552:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784405071.239557:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083729039616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405071.239581:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083729039616:12345-0@lo:400:kworker.0 Request processed in 24us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405071.239587:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784405071.239595:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784405071.239600:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083729040256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405071.239620:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083729040256:12345-0@lo:400:kworker.0 Request processed in 20us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405071.239625:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784405071.239661:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729039872:0@lo:8:kworker.0 00000100:00100000:2.0:1784405071.239690:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405071.239724:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729039872 00010000:00080000:1.0:1784405071.239963:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd5732b8000 x1871083729039616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405071.239974:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083729039616:0@lo:400:kworker.0 00010000:00080000:1.0:1784405071.239988:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd5732b8700 x1871083729040256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405071.239996:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083729040256:0@lo:400:kworker.0 00000100:00100000:2.0:1784405071.240807:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729039872 00000100:00100000:3.0:1784405071.240964:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729039488:0@lo:400:kworker.0 00010000:00080000:3.0:1784405071.241012:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd5732bbb80 x1871083729040128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405071.241022:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1871083729040128:0@lo:400:kworker.0 00000100:00100000:3.0:1784405071.241032:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3646:1871083729039360:0@lo:400:kworker.0 00010000:00080000:3.0:1784405071.241042:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd5732b9880 x1871083729040000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405071.241050:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083729040000:0@lo:400:kworker.0 00000100:00100000:2.0:1784405071.241507:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784405071.241515:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1871083729039872:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1784405071.241541:0:24225:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784405071.241617:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1871083729039872:12345-0@lo:8:kworker.0 Request processed in 102us (1926us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784405071.241624:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1784405071.243791:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784405071.243808:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784405071.243813:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729039872:0@lo:8:kworker.0 00010000:00010000:3.0:1784405071.875085:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784405072.259115:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784405052/real 1784405052] req@ffff9dd573b98000 x1871083729030912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405072 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405072.259146:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd573b98000 x1871083729030912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405072 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405072.259157:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784405052/real 1784405052] req@ffff9dd573b99c00 x1871083729031040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405072 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405072.259169:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44242e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729040384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784405072.259171:0:3645:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dd573b99c00 x1871083729031040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784405072 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784405072.259219:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd57329b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1784405072.259236:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784405072.259238:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784405072.259252:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729030912:0@lo:8:kworker.0 00000100:00080000:1.0:1784405072.259260:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd443585000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784405072.259266:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784405072.259270:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729031040:0@lo:8:kworker.0 00000100:00100000:3.0:1784405072.259290:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729040384 00000100:00100000:3.0:1784405072.259297:0:23457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729040384 00000100:00100000:3.0:1784405072.259339:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784405072.259347:0:23457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729040384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784405072.259394:0:23457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1784405072.259449:0:23457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729040384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405072.259457:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1784405072.259497:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784405072.259502:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:3.0:1784405072.259503:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3646:1871083729040512:0@lo:400:kworker.0 00000100:00080000:1.0:1784405072.259505:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd57329b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784405072.259514:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 670 00000100:00080000:1.0:1784405072.259519:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784405072.259524:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9dd57329b000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784405072.259539:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405072.259557:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd574d36300 x1871083729040768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784405072.259569:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1784405072.259573:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1784405072.259578:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729040640:0@lo:400:kworker.0 00000100:00080000:1.0:1784405072.259580:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784405072.259583:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd443585000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784405072.259588:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 670 00000100:00080000:1.0:1784405072.259592:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784405072.259595:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd443585000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784405072.259609:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405072.259610:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd574d37800 x1871083729040896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784405072.259643:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729040512 00000100:00080000:1.0:1784405072.259643:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1784405072.259648:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729040512 00000100:00080000:1.0:1784405072.259654:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784405072.259657:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784405072.259661:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 689 00000100:00080000:1.0:1784405072.259664:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784405072.259668:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd574d7e800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784405072.259682:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd574d37100 x1871083729041280/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784405072.259683:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784405072.259695:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:3646:x1871083729040512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405072.259731:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:3646:x1871083729040512:12345-0@lo:400:kworker.0 Request processed in 38us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405072.259738:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784405072.259742:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083729041536:0@lo:400:kworker.0 00000100:00100000:3.0:1784405072.259769:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729040640 00000100:00100000:3.0:1784405072.259774:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729040640 00000100:00100000:1.0:1784405072.259788:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405072.259799:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784405072.259815:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784405072.259822:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083729041408:0@lo:400:kworker.0 00000100:00100000:1.0:1784405072.259946:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405072.260021:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729040768:0@lo:8:kworker.0 00000100:00100000:1.0:1784405072.260047:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405072.260067:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729040896:0@lo:8:kworker.0 00000100:00100000:1.0:1784405072.260084:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405072.260097:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729041280:0@lo:8:kworker.0 00000100:00100000:1.0:1784405072.260114:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405072.260336:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083729040640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405072.260374:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083729040640:12345-0@lo:400:kworker.0 Request processed in 569us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405072.260381:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784405072.260417:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083729041024:0@lo:400:kworker.0 00000100:00100000:3.0:1784405072.260442:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405072.261138:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729040768 00000100:00100000:2.0:1784405072.261146:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729040768 00000100:00100000:2.0:1784405072.261164:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729040896 00000100:00100000:2.0:1784405072.261167:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729040896 00000100:00100000:2.0:1784405072.261173:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729041280 00000100:00100000:2.0:1784405072.261175:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729041280 00000100:00100000:2.0:1784405072.261186:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784405072.261191:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1871083729040768:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1784405072.261213:0:24225:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:2.0:1784405072.261234:0:24225:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd7a9ce 00002000:00100000:2.0:1784405072.261245:0:24225:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9dd443141000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ae ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1784405072.261247:0:24225:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1784405072.261249:0:24225:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784405072.261309:0:24225:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784405072.261326:0:24225:0:(import.c:65:import_set_state_nolock()) ffff9dd443140800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784405072.261365:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1871083729040768:12345-0@lo:8:kworker.0 Request processed in 173us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405072.261369:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784405072.261379:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784405072.261394:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1871083729040896:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1784405072.261406:0:24225:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784405072.261437:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1871083729040896:12345-0@lo:8:kworker.0 Request processed in 53us (1352us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784405072.261442:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784405072.261454:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784405072.261457:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1871083729041280:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1784405072.261466:0:24225:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784405072.261508:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1871083729041280:12345-0@lo:8:kworker.0 Request processed in 48us (1392us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784405072.261514:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784405072.265068:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083729041664:0@lo:400:kworker.0 00000100:00100000:3.0:1784405072.265131:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405072.265188:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729041536 00000100:00100000:0.0:1784405072.265197:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729041536 00000100:00100000:0.0:1784405072.265713:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729041408 00000100:00100000:0.0:1784405072.265718:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729041408 00000100:00100000:0.0:1784405072.265731:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729041024 00000100:00100000:0.0:1784405072.265733:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729041024 00000100:00100000:1.0:1784405072.265764:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729041664 00000100:00100000:1.0:1784405072.265768:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729041664 00000100:00100000:3.0:1784405072.265787:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784405072.265797:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729041152:0@lo:400:kworker.0 00000100:00100000:3.0:1784405072.265831:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1784405072.267139:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd574d36300 x1871083729040768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784405097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784405072.267152:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784405072.267160:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1784405072.267168:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784405072.267174:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1784405072.267176:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd57329b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784405072.267191:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784405072.267196:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729040768:0@lo:8:kworker.0 00000100:00080000:2.0:1784405072.267210:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd443585000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784405072.267214:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784405072.267217:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729040896:0@lo:8:kworker.0 00000100:00080000:2.0:1784405072.267225:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784405072.267227:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784405072.267230:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729041280:0@lo:8:kworker.0 00000004:00080000:2.0:1784405072.267286:0:22742:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:2.0:1784405072.267302:0:22742:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22742:1871083729041920:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784405072.267337:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405072.267349:0:22742:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57b4c4d80 going to sleep for 11 seconds 00000004:00080000:2.0:1784405072.267365:0:22741:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1784405072.267366:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784405072.267394:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083729041536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405072.267457:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083729041536:12345-0@lo:400:kworker.0 Request processed in 78us (7669us total) trans 0 rc 0/0 00000004:00080000:2.0:1784405072.267653:0:22741:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690151800782ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784405072.267658:0:22741:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1784405072.273680:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784405072.273699:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083729041408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405072.273790:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083729041408:12345-0@lo:400:kworker.0 Request processed in 98us (13843us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405072.273797:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784405072.273820:0:22717:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1784405072.273828:0:22717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1784405072.273876:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729041792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784405072.273912:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405072.273963:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44242e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729040384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784405072.274002:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729041792 00000100:00100000:3.0:1784405072.274008:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729041792 00000100:00100000:3.0:1784405072.274050:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784405072.274057:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1871083729041792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784405072.274071:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1784405072.274107:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1871083729041792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405072.274113:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1784405072.274129:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784405072.274155:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729040640:0@lo:400:kworker.0 00000100:00100000:3.0:1784405072.274164:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3646:1871083729040512:0@lo:400:kworker.0 00010000:00080000:3.0:1784405072.274195:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd443d85880 x1871083729041792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784405088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405072.274221:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729041792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784405072.274240:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729041152 00000100:00100000:3.0:1784405072.274244:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729041152 00000100:00100000:3.0:1784405072.274261:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729041920 00000100:00100000:3.0:1784405072.274263:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729041920 00000100:00100000:3.0:1784405072.274275:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784405072.274281:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729041152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405072.274311:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729041152:12345-0@lo:400:kworker.0 Request processed in 30us (8479us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405072.274317:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784405072.274328:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784405072.274334:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22742:x1871083729041920:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:1.0:1784405072.274846:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd574d35f80 x1871083729041408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405072.274874:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083729041408:0@lo:400:kworker.0 00010000:00080000:1.0:1784405072.274888:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd574d34a80 x1871083729041536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405072.274910:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083729041536:0@lo:400:kworker.0 00000100:00100000:1.0:1784405072.274929:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784405072.274935:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729042048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784405072.274966:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405072.276485:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1784405072.276503:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784405072.276517:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083729041024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405072.276668:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083729041024:12345-0@lo:400:kworker.0 Request processed in 156us (16223us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405072.276676:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784405072.276698:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1784405072.276704:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784405072.276713:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083729041664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405072.276744:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083729041664:12345-0@lo:400:kworker.0 Request processed in 32us (11613us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405072.276750:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784405072.280657:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784405072.280793:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729042048 00000100:00100000:3.0:1784405072.280804:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729042048 00000100:00100000:3.0:1784405072.280870:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784405072.280882:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729042048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784405072.280922:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784405072.281008:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729042048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (6040us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405072.281015:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784405072.281063:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729042048:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1784405072.281112:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd574d36a00 x1871083729041152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784405088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405072.281123:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729041152:0@lo:400:kworker.0 00010000:00080000:3.0:1784405072.281149:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd574d36d80 x1871083729041024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405072.281159:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083729041024:0@lo:400:kworker.0 00010000:00080000:3.0:1784405072.281171:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd573b99c00 x1871083729041664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405072.281179:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573b99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083729041664:0@lo:400:kworker.0 00002000:00080000:3.0:1784405072.283302:0:24225:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1784405072.283315:0:24225:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1784405072.283321:0:24225:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000004:00080000:0.0:1784405072.298570:0:22696:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1784405072.302061:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405072.302073:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060870702/0x24b3e2e6dcd7a9d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.302090:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1784405072.302095:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405072.302102:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060870702/0x24b3e2e6dcd7a9d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.302120:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060870702/0x24b3e2e6dcd7a9d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.302130:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060870702/0x24b3e2e6dcd7a9d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.302137:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060870702/0x24b3e2e6dcd7a9d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.302169:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784405072.302278:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784405072.302285:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060870702/0x24b3e2e6dcd7a9d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.302293:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784405072.302297:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060870702/0x24b3e2e6dcd7a9d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.302306:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060870702/0x24b3e2e6dcd7a9d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.302324:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060870702/0x24b3e2e6dcd7a9d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.302332:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060870702/0x24b3e2e6dcd7a9d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.302351:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405072.302353:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405072.302355:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784405072.303528:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405072.303538:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7a9dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.303551:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1784405072.303556:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405072.303560:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7a9dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.303573:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7a9dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.303581:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7a9dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.303589:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7a9dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.303616:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784405072.303884:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784405072.303890:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7a9dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405072.303896:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784405072.303898:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7a9dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405072.303906:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7a9dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405072.303927:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7a9dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405072.303935:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7a9dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405072.303957:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405072.303959:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405072.303961:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784405072.304274:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405072.304280:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001214bcab/0x24b3e2e6dcd7a9e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.304288:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1784405072.304297:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405072.304301:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001214bcab/0x24b3e2e6dcd7a9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.304311:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001214bcab/0x24b3e2e6dcd7a9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.304318:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001214bcab/0x24b3e2e6dcd7a9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.304325:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001214bcab/0x24b3e2e6dcd7a9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.304345:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784405072.304642:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784405072.304648:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001214bcab/0x24b3e2e6dcd7a9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.304655:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056c00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784405072.304659:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001214bcab/0x24b3e2e6dcd7a9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.304679:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001214bcab/0x24b3e2e6dcd7a9e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.304692:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001214bcab/0x24b3e2e6dcd7a9e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.304700:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001214bcab/0x24b3e2e6dcd7a9e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.304716:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405072.304717:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405072.304719:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784405072.304758:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405072.304764:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084a259e6/0x24b3e2e6dcd7a9ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.304772:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1784405072.304775:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405072.304780:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084a259e6/0x24b3e2e6dcd7a9ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.304789:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084a259e6/0x24b3e2e6dcd7a9ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.304798:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084a259e6/0x24b3e2e6dcd7a9ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.304812:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084a259e6/0x24b3e2e6dcd7a9ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.304833:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784405072.305183:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405072.305189:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7a9f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.305198:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1784405072.305201:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405072.305205:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7a9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.305214:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7a9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.305222:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7a9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.305229:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7a9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.305246:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784405072.305435:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784405072.305441:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084a259e6/0x24b3e2e6dcd7a9ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.305449:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057600 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784405072.305453:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084a259e6/0x24b3e2e6dcd7a9ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.305461:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084a259e6/0x24b3e2e6dcd7a9ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.305472:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084a259e6/0x24b3e2e6dcd7a9ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.305489:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084a259e6/0x24b3e2e6dcd7a9ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405072.305494:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784405072.305503:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405072.305505:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405072.305506:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784405072.306210:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405072.306218:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7a9f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.306235:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1784405072.306239:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405072.306244:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7a9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.306254:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7a9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.306262:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7a9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.306270:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7a9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.306294:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784405072.306419:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784405072.306432:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7a9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.306442:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784405072.306447:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7a9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.306455:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7a9f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.306470:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7a9f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.306477:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7a9f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.306493:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.306495:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.306496:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784405072.306654:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405072.306660:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096373a76/0x24b3e2e6dcd7a9ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.306668:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1784405072.307148:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405072.307155:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096373a76/0x24b3e2e6dcd7a9ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.307167:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096373a76/0x24b3e2e6dcd7a9ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.307184:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096373a76/0x24b3e2e6dcd7a9ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.307190:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096373a76/0x24b3e2e6dcd7a9ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.307212:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784405072.307620:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405072.307626:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7aa06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.307634:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1784405072.307638:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405072.307642:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7aa06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.307651:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7aa06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.307658:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7aa06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.307665:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7aa06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.307684:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784405072.307883:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784405072.307888:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096373a76/0x24b3e2e6dcd7a9ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.307896:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056e00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784405072.307900:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096373a76/0x24b3e2e6dcd7a9ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.307908:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096373a76/0x24b3e2e6dcd7a9ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.307921:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096373a76/0x24b3e2e6dcd7a9ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.307929:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096373a76/0x24b3e2e6dcd7a9ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.307964:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7a9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.307981:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784405072.307984:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7a9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.307991:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7a9f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.308001:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7a9f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.308007:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7a9f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.308020:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784405072.308024:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7aa06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.308030:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057e00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784405072.308033:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7aa06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.308040:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7aa06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.308049:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7aa06 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.308062:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7aa06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.308075:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405072.308077:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405072.308080:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405072.308085:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405072.308087:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405072.308089:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784405072.308882:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405072.308890:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa0d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.308903:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1784405072.308907:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405072.308912:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.308923:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.308930:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.308938:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.309073:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784405072.309396:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784405072.309402:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000139287e4/0x24b3e2e6dcd7aa14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.309412:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=690s v=(0 0) 00010000:00010000:2.0:1784405072.309415:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784405072.309419:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000139287e4/0x24b3e2e6dcd7aa14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.309427:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000139287e4/0x24b3e2e6dcd7aa14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.309435:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000139287e4/0x24b3e2e6dcd7aa14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.309440:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000139287e4/0x24b3e2e6dcd7aa14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.309459:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784405072.309541:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784405072.309547:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.309554:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784405072.309558:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.309566:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.309580:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa0d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.309588:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.309605:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784405072.309609:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000139287e4/0x24b3e2e6dcd7aa14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.309615:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7c00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784405072.309618:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000139287e4/0x24b3e2e6dcd7aa14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.309637:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000139287e4/0x24b3e2e6dcd7aa14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.309648:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000139287e4/0x24b3e2e6dcd7aa14 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.309655:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000139287e4/0x24b3e2e6dcd7aa14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.309668:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405072.309670:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405072.309671:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405072.309761:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784405072.310266:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405072.310273:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.310284:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1784405072.310295:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405072.310300:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.310310:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.310317:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.310325:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.310340:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784405072.310680:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784405072.310687:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.310697:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784405072.310701:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.310723:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.310738:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa1b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.310746:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.310766:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.310769:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.310771:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784405072.310906:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405072.310913:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.310922:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1784405072.310926:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405072.310931:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.310942:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.310951:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.310966:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.310985:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784405072.311110:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784405072.311116:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.311124:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167f000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784405072.311128:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.311137:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.311149:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa22 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.311167:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.311182:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.311184:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.311185:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784405072.311438:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405072.311444:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.311453:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1784405072.311457:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405072.311461:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.311471:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.311478:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.311485:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.311506:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784405072.311638:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784405072.311644:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.311651:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167fc00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784405072.311655:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.311662:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.311672:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa29 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.311679:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.311693:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.311694:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.311696:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784405072.312040:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405072.312046:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa30 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.312059:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1784405072.312062:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405072.312066:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.312087:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.312094:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.312101:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.312146:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784405072.312617:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405072.312623:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000501221df/0x24b3e2e6dcd7aa37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.312632:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1784405072.312635:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405072.312640:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000501221df/0x24b3e2e6dcd7aa37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.312649:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000501221df/0x24b3e2e6dcd7aa37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.312668:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000501221df/0x24b3e2e6dcd7aa37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.312675:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000501221df/0x24b3e2e6dcd7aa37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.312701:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784405072.312706:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.312714:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784405072.312717:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.312725:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.312736:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa30 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.312743:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.312772:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784405072.312776:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000501221df/0x24b3e2e6dcd7aa37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.312782:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151be00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784405072.312786:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000501221df/0x24b3e2e6dcd7aa37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.312793:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000501221df/0x24b3e2e6dcd7aa37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.312814:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000501221df/0x24b3e2e6dcd7aa37 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.312822:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.312823:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.312825:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405072.313179:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784405072.313184:0:24225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000501221df/0x24b3e2e6dcd7aa37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784405072.313515:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405072.313521:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd7aa3e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.313529:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1784405072.313533:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405072.313536:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd7aa3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.313545:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd7aa3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.313553:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd7aa3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.313570:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd7aa3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.313601:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784405072.313606:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd7aa3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.313614:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784405072.313617:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd7aa3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.313625:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd7aa3e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.313635:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd7aa3e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.313643:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.313644:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.313646:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.315911:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.325165:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405072.325217:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784405072.325231:0:24225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e9a00a4/0x24b3e2e6dcd7aa3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784405072.326008:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784405072.326016:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001386a90f/0x24b3e2e6dcd7aa45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.326031:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=690s v=(0 0) 00010000:00010000:2.0:1784405072.326036:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784405072.326042:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001386a90f/0x24b3e2e6dcd7aa45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.326057:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001386a90f/0x24b3e2e6dcd7aa45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.326067:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001386a90f/0x24b3e2e6dcd7aa45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.326991:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001386a90f/0x24b3e2e6dcd7aa45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405072.327060:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784405072.329561:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405072.329577:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000585e5a6f/0x24b3e2e6dcd7aa4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.329596:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=690s v=(0 0) 00010000:00010000:3.0:1784405072.329601:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405072.329607:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000585e5a6f/0x24b3e2e6dcd7aa4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.329622:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000585e5a6f/0x24b3e2e6dcd7aa4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.329632:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000585e5a6f/0x24b3e2e6dcd7aa4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.329640:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000585e5a6f/0x24b3e2e6dcd7aa4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.335487:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784405072.335513:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001386a90f/0x24b3e2e6dcd7aa45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.335527:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784405072.335532:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001386a90f/0x24b3e2e6dcd7aa45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.335543:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001386a90f/0x24b3e2e6dcd7aa45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.335566:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001386a90f/0x24b3e2e6dcd7aa45 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.335573:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001386a90f/0x24b3e2e6dcd7aa45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.335594:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784405072.335598:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000585e5a6f/0x24b3e2e6dcd7aa4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.335604:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b600 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784405072.335607:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000585e5a6f/0x24b3e2e6dcd7aa4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.335615:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000585e5a6f/0x24b3e2e6dcd7aa4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.335636:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000585e5a6f/0x24b3e2e6dcd7aa4c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.335643:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.335645:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.335647:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405072.336499:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784405072.336511:0:24225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000585e5a6f/0x24b3e2e6dcd7aa4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.336599:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784405072.344057:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784405072.344070:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7aa53 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.344087:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=690s v=(0 0) 00010000:00010000:0.0:1784405072.344092:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784405072.344098:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7aa53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.344113:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7aa53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.344123:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7aa53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.344131:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7aa53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.344154:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784405072.344324:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784405072.344331:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7aa53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405072.344339:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443549400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784405072.344343:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7aa53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405072.344353:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7aa53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405072.344370:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7aa53 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405072.344378:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000724a9dfb/0x24b3e2e6dcd7aa53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405072.344414:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405072.344416:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405072.344418:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784405072.344679:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784405072.344685:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa5a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.344693:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=690s v=(0 0) 00010000:00010000:0.0:1784405072.344697:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784405072.344701:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.344710:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.344718:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.344725:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.344746:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784405072.345261:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784405072.345266:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa61 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.345275:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=690s v=(0 0) 00010000:00010000:0.0:1784405072.345278:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784405072.345282:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.345302:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.345309:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.345315:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.345328:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784405072.345430:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784405072.345436:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.345444:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784405072.345447:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.345455:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.345467:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa5a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.345475:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.345498:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784405072.345501:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.345507:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784405072.345510:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.345517:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.345528:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa61 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.345535:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa61 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.345547:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.345549:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.345550:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405072.345664:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784405072.353632:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784405072.353650:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa68 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.353672:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=690s v=(0 0) 00010000:00010000:0.0:1784405072.353686:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784405072.353693:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.353709:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.353721:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.353728:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.354498:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784405072.354995:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784405072.355003:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.355016:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=690s v=(0 0) 00010000:00010000:0.0:1784405072.355020:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784405072.355026:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.355038:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.355047:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.355062:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.359459:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784405072.359474:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.359489:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167fc00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784405072.359494:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.359507:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.359530:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa68 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.359538:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000884b0c88/0x24b3e2e6dcd7aa68 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.359560:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784405072.359564:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.359581:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167f000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784405072.359584:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.359592:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa6f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.359603:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa6f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.359611:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405072.359613:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405072.359615:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.361583:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784405072.361597:0:24225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e052b4f/0x24b3e2e6dcd7aa6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.361666:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784405072.362546:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784405072.362555:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa76 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.362569:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=690s v=(0 0) 00010000:00010000:0.0:1784405072.362573:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784405072.362580:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.362594:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.362604:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.362612:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.362643:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784405072.363104:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784405072.363111:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.363120:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=690s v=(0 0) 00010000:00010000:0.0:1784405072.363123:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784405072.363127:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.363136:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.363144:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.363153:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.363166:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784405072.363467:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784405072.363475:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.363486:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784405072.363491:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.363502:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.363521:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa76 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.363535:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001833cd83/0x24b3e2e6dcd7aa76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.363553:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784405072.363556:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.363563:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784405072.363566:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.363574:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.363584:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa7d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.363591:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f8153fa/0x24b3e2e6dcd7aa7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.363600:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405072.363602:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405072.363604:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405072.363620:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784405072.363867:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784405072.363872:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa84 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.363879:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=690s v=(0 0) 00010000:00010000:0.0:1784405072.363887:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784405072.363890:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.363897:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.363902:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.363906:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.363917:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784405072.363925:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784405072.363929:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.363935:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd54167e200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784405072.363938:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.363946:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.363956:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa84 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.363974:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1f629ad/0x24b3e2e6dcd7aa84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.363986:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.363987:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.363988:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784405072.364583:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784405072.364590:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.364600:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=690s v=(0 0) 00010000:00010000:0.0:1784405072.364603:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784405072.364608:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.364618:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.364627:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.364634:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.364653:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784405072.365149:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784405072.365161:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bd2f982/0x24b3e2e6dcd7aa92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.365171:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=690s v=(0 0) 00010000:00010000:0.0:1784405072.365175:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784405072.365179:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bd2f982/0x24b3e2e6dcd7aa92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.365190:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bd2f982/0x24b3e2e6dcd7aa92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.365199:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bd2f982/0x24b3e2e6dcd7aa92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.365371:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bd2f982/0x24b3e2e6dcd7aa92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.365394:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784405072.365900:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784405072.365907:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000430c3474/0x24b3e2e6dcd7aa99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.365917:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=690s v=(0 0) 00010000:00010000:0.0:1784405072.365921:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784405072.365926:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000430c3474/0x24b3e2e6dcd7aa99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.365937:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000430c3474/0x24b3e2e6dcd7aa99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.365954:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000430c3474/0x24b3e2e6dcd7aa99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.365962:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000430c3474/0x24b3e2e6dcd7aa99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.365977:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1784405072.365988:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784405072.365993:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.366001:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443548000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784405072.366005:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.366013:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.366026:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa8b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.366033:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009194b7f1/0x24b3e2e6dcd7aa8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.366048:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784405072.366058:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bd2f982/0x24b3e2e6dcd7aa92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.366065:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821da200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784405072.366068:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bd2f982/0x24b3e2e6dcd7aa92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.366609:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bd2f982/0x24b3e2e6dcd7aa92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.366621:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bd2f982/0x24b3e2e6dcd7aa92 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.366630:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bd2f982/0x24b3e2e6dcd7aa92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.366646:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784405072.366650:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000430c3474/0x24b3e2e6dcd7aa99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.366657:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821dbc00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784405072.366661:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000430c3474/0x24b3e2e6dcd7aa99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.366669:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000430c3474/0x24b3e2e6dcd7aa99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.366691:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000430c3474/0x24b3e2e6dcd7aa99 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.366698:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000430c3474/0x24b3e2e6dcd7aa99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.366713:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.366715:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.366717:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405072.367453:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405072.367462:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784405072.367689:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784405072.367697:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006b267e3/0x24b3e2e6dcd7aaa0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.367711:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=690s v=(0 0) 00010000:00010000:0.0:1784405072.367715:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784405072.367721:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006b267e3/0x24b3e2e6dcd7aaa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.367734:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006b267e3/0x24b3e2e6dcd7aaa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.367744:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006b267e3/0x24b3e2e6dcd7aaa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.367752:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006b267e3/0x24b3e2e6dcd7aaa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.367785:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784405072.367795:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784405072.367799:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006b267e3/0x24b3e2e6dcd7aaa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.367806:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821dae00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784405072.367809:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006b267e3/0x24b3e2e6dcd7aaa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.367816:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006b267e3/0x24b3e2e6dcd7aaa0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.367830:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006b267e3/0x24b3e2e6dcd7aaa0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.367837:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006b267e3/0x24b3e2e6dcd7aaa0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.367879:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.367882:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405072.367883:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784405072.370871:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784405072.370887:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030923c7b/0x24b3e2e6dcd7aaa7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.370905:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=690s v=(0 0) 00010000:00010000:0.0:1784405072.370918:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784405072.370926:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030923c7b/0x24b3e2e6dcd7aaa7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.370940:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030923c7b/0x24b3e2e6dcd7aaa7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.370951:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030923c7b/0x24b3e2e6dcd7aaa7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.370960:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030923c7b/0x24b3e2e6dcd7aaa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405072.370980:0:24225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1784405072.371063:0:24225:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:0.0:1784405072.371176:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22742:x1871083729041920:12345-0@lo:5:osp-pre-0-0.0 Request processed in 96837us (103833us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405072.371186:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784405072.371198:0:22742:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22742:1871083729041920:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784405072.371216:0:22742:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:2.0:1784405072.371259:0:22742:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22742:1871083729042176:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784405072.371292:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405072.371324:0:22742:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57b4c4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784405072.371876:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729042176 00000100:00100000:0.0:1784405072.371883:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729042176 00000100:00100000:0.0:1784405072.371926:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784405072.371935:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22742:x1871083729042176:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1784405072.371979:0:24224:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:3.0:1784405072.372046:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784405072.372055:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030923c7b/0x24b3e2e6dcd7aaa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.372065:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821dac00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784405072.372069:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030923c7b/0x24b3e2e6dcd7aaa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.372080:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030923c7b/0x24b3e2e6dcd7aaa7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.372101:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030923c7b/0x24b3e2e6dcd7aaa7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.372108:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030923c7b/0x24b3e2e6dcd7aaa7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405072.372129:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405072.372131:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405072.372133:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784405072.384661:0:24219:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1784405072.384712:0:24219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1784405072.402570:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22742:x1871083729042176:12345-0@lo:5:osp-pre-0-0.0 Request processed in 30623us (31264us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1784405072.402588:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784405072.402648:0:22742:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1784405072.402657:0:22742:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22742:1871083729042176:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784405072.402674:0:22742:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:3.0:1784405072.899238:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784405073.165250:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784405073.931292:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784405074.365395:0:25039:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784405074.365402:0:25039:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1784405074.365404:0:25039:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1784405074.365558:0:25039:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9dd443141800 00000020:01000004:2.0:1784405074.365581:0:25039:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1784405074.365599:0:25039:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784405074.366380:0:25039:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9dd4430a4d40) 00000020:00000080:2.0:1784405074.366402:0:25039:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784405074.455141:0:25039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784405074.458772:0:25039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1784405074.460811:0:25039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1784405074.465504:0:25039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1784405074.466205:0:25039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1784405074.466896:0:25039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784405074.467257:0:25039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1784405074.474237:0:25039:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784405074.474658:0:25039:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1784405074.474834:0:25039:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784405074.474950:0:25039:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x24b3e2e6dcd7aab5 00000020:01000004:2.0:1784405074.474958:0:25039:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1784405074.474982:0:25039:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.142@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784405074.474985:0:25039:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784405074.474991:0:25039:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1784405074.475022:0:25039:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1784405074.475027:0:25039:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.142@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1784405074.507280:0:25039:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.142@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784405074.507326:0:25039:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.142@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1784405074.507332:0:25039:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784405074.507339:0:25039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784405074.507340:0:25039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784405074.507341:0:25039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784405074.507342:0:25039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784405074.507343:0:25039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784405074.507345:0:25039:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784405074.507346:0:25039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784405074.507347:0:25039:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784405074.507351:0:25039:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1784405074.507353:0:25039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784405074.507354:0:25039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784405074.507355:0:25039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784405074.507356:0:25039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784405074.507356:0:25039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784405074.507357:0:25039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784405074.507358:0:25039:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784405074.507359:0:25039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784405074.507360:0:25039:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784405074.507527:0:25039:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784405074.507558:0:25039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729042304:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784405074.507660:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405074.508004:0:25039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443770540 going to sleep for 11 seconds 00000100:00100000:2.0:1784405074.508231:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729042304 00000100:00100000:2.0:1784405074.508239:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729042304 00000100:00100000:0.0:1784405074.508552:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784405074.508570:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:25039:x1871083729042304:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784405074.508600:0:22710:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1784405074.508603:0:22710:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1784405074.508606:0:22710:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1784405074.509033:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:25039:x1871083729042304:12345-0@lo:253:mount.lustre.0 Request processed in 464us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405074.509041:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784405074.509128:0:25039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729042304:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784405074.509139:0:25039:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784405074.509141:0:25039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784405074.509143:0:25039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784405074.509144:0:25039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784405074.509145:0:25039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784405074.509147:0:25039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784405074.509148:0:25039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784405074.509149:0:25039:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784405074.509150:0:25039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784405074.509151:0:25039:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784405074.509171:0:25039:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dd443141800 from lustre-OST0001 10000000:01000000:1.0:1784405074.509199:0:25039:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1784405074.509202:0:25039:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784405074.509210:0:25039:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9dd44213b380 local copy 00010000:00010000:1.0:1784405074.509220:0:25039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd7a6ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a6f6 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405074.509307:0:25039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729042432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784405074.509336:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405074.509768:0:25039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b5e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784405074.509961:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729042432 00000100:00100000:3.0:1784405074.509966:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729042432 00000100:00100000:3.0:1784405074.509998:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784405074.510004:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:25039:x1871083729042432:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784405074.510083:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:25039:x1871083729042432:12345-0@lo:501:mount.lustre.0 Request processed in 80us (746us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784405074.510090:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784405074.510618:0:25039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729042432:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1784405074.510639:0:25039:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784405074.510659:0:25039:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784405074.510805:0:25039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd7a6ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a6f6 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405074.510829:0:25039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd443548200/0x24b3e2e6dcd7a6ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7a6f6 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784405074.510891:0:25039:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dd443141800 10000000:01000000:1.0:1784405074.510897:0:25039:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784405074.510902:0:25039:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784405074.510905:0:25039:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784405074.510909:0:25039:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1784405074.510911:0:25039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784405074.510938:0:25039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd57331cc00/0x24b3e2e6dcd7aabc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405074.510945:0:25039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd57331cc00/0x24b3e2e6dcd7aabc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405074.510955:0:25039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd57331cc00/0x24b3e2e6dcd7aabc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405074.510971:0:25039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729042560:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784405074.511008:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405074.511036:0:25039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b5e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784405074.511156:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729042560 00000100:00100000:3.0:1784405074.511161:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729042560 00000100:00100000:3.0:1784405074.511188:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784405074.511195:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:25039:x1871083729042560:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784405074.511206:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784405074.511224:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151b600/0x24b3e2e6dcd7aac3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7aabc expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405074.511257:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151b600/0x24b3e2e6dcd7aac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7aabc expref: 22 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405074.511267:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151b600/0x24b3e2e6dcd7aac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7aabc expref: 22 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405074.511275:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b600, rc 0) 00000100:00100000:3.0:1784405074.511308:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+22:25039:x1871083729042560:12345-0@lo:101:mount.lustre.0 Request processed in 113us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405074.511314:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784405074.511559:0:25039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729042560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784405074.511572:0:25039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd57331cc00/0x24b3e2e6dcd7aabc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7aac3 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405074.511580:0:25039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd57331cc00/0x24b3e2e6dcd7aabc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7aac3 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784405074.514906:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1784405074.515944:0:25039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784405074.519309:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1784405074.519384:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1784405074.519403:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1784405074.519911:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1784405074.519935:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1784405074.519951:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1784405074.519965:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1784405074.519979:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1784405074.519991:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1784405074.520016:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1784405074.520021:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1784405074.520137:0:25039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729042688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784405074.520212:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405074.522935:0:25039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443770540 going to sleep for 11 seconds 00000100:00100000:1.0:1784405074.523320:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729042688 00000100:00100000:1.0:1784405074.523331:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729042688 00000100:00100000:2.0:1784405074.523439:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784405074.523452:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+22:25039:x1871083729042688:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784405074.523659:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+22:25039:x1871083729042688:12345-0@lo:501:mount.lustre.0 Request processed in 211us (3446us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405074.523826:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784405074.523984:0:25039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729042688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784405074.524155:0:25039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729042816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784405074.524205:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405074.524243:0:25039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443770540 going to sleep for 11 seconds 00000100:00100000:0.0:1784405074.524348:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729042816 00000100:00100000:0.0:1784405074.524353:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729042816 00000100:00100000:0.0:1784405074.524406:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784405074.524414:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+22:25039:x1871083729042816:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784405074.525332:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+22:25039:x1871083729042816:12345-0@lo:503:mount.lustre.0 Request processed in 915us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405074.525340:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784405074.525626:0:25039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729042816:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784405074.526575:0:25039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784405074.526782:0:25039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729042944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784405074.526892:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405074.526931:0:25039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443770540 going to sleep for 11 seconds 00000100:00100000:0.0:1784405074.527028:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729042944 00000100:00100000:0.0:1784405074.527036:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729042944 00000100:00100000:0.0:1784405074.527092:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784405074.527100:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+22:25039:x1871083729042944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784405074.527884:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+22:25039:x1871083729042944:12345-0@lo:502:mount.lustre.0 Request processed in 782us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405074.527893:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784405074.528016:0:25039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729042944:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784405074.529032:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1784405074.529149:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1784405074.529169:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1784405074.529183:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1784405074.529193:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1784405074.529204:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1784405074.529215:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1784405074.529225:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1784405074.529236:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1784405074.529330:0:25039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729043072:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784405074.529516:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405074.529598:0:25039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443770540 going to sleep for 11 seconds 00000100:00100000:1.0:1784405074.529692:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729043072 00000100:00100000:1.0:1784405074.529700:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729043072 00000100:00100000:1.0:1784405074.529733:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784405074.529741:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+22:25039:x1871083729043072:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784405074.529871:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+22:25039:x1871083729043072:12345-0@lo:502:mount.lustre.0 Request processed in 130us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405074.529878:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784405074.530076:0:25039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729043072:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784405074.530125:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1784405074.530133:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1784405074.531661:0:25043:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784405074.531798:0:25043:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1784405074.531822:0:25043:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784405074.531825:0:25043:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1784405074.531831:0:25043:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784405074.531884:0:25043:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9dd545b94d40) 00000020:00000080:3.0:1784405074.531923:0:25043:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784405074.531932:0:25043:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784405074.532014:0:25043:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd443141800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1784405074.532024:0:25043:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784405074.532032:0:25043:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x24b3e2e6dcd7aad1 00010000:00010000:3.0:1784405074.540163:0:25043:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1784405074.540766:0:25043:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1784405074.542336:0:25043:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1784405074.544801:0:25043:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1784405074.544815:0:25043:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784405074.544822:0:25043:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784405074.544824:0:25043:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1784405074.544828:0:25043:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784405074.544831:0:25043:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784405074.544832:0:25043:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784405074.544835:0:25043:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784405074.544837:0:25043:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784405074.544840:0:25043:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784405074.544871:0:25043:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784405074.544873:0:25043:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784405074.544876:0:25043:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784405074.544879:0:25043:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784405074.544881:0:25043:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784405074.544884:0:25043:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1784405074.544912:0:25043:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784405074.544915:0:25043:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784405074.544917:0:25043:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784405074.544921:0:25043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1784405074.547172:0:25039:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1784405074.547217:0:25039:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784405074.547245:0:25039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd57331cc00/0x24b3e2e6dcd7aabc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7aac3 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405074.547260:0:25039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd57331cc00/0x24b3e2e6dcd7aabc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7aac3 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784405074.547268:0:25039:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd443141800 from 1 10000000:01000000:1.0:1784405074.547271:0:25039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784405074.547312:0:25039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd57331d200/0x24b3e2e6dcd7aad8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405074.547321:0:25039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd57331d200/0x24b3e2e6dcd7aad8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405074.547331:0:25039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd57331d200/0x24b3e2e6dcd7aad8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405074.547377:0:25039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729043200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784405074.547467:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405074.547511:0:25039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd58160cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784405074.548248:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729043200 00000100:00100000:2.0:1784405074.548256:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729043200 00000100:00100000:2.0:1784405074.548300:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784405074.548308:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+22:25039:x1871083729043200:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784405074.548321:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784405074.548334:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd4425c6600/0x24b3e2e6dcd7aadf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7aad8 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405074.548358:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd4425c6600/0x24b3e2e6dcd7aadf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7aad8 expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405074.548379:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd4425c6600/0x24b3e2e6dcd7aadf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7aad8 expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405074.548387:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c6600, rc 0) 00000100:00100000:2.0:1784405074.548595:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:25039:x1871083729043200:12345-0@lo:101:mount.lustre.0 Request processed in 287us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405074.548602:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784405074.548706:0:25039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729043200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784405074.548725:0:25039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd57331d200/0x24b3e2e6dcd7aad8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7aadf expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405074.548734:0:25039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd57331d200/0x24b3e2e6dcd7aad8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7aadf expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784405074.550193:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1784405074.550587:0:25039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784405074.552200:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1784405074.552260:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1784405074.552278:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1784405074.552292:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1784405074.552307:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1784405074.552319:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1784405074.552331:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1784405074.552344:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1784405074.552359:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1784405074.553541:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1784405074.553558:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1784405074.553579:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1784405074.553585:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1784405074.554082:0:25039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729043328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784405074.554152:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405074.554200:0:25039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd541359480 going to sleep for 11 seconds 00000100:00100000:2.0:1784405074.554271:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729043328 00000100:00100000:2.0:1784405074.554280:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729043328 00000100:00100000:2.0:1784405074.554332:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784405074.554347:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:25039:x1871083729043328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784405074.554656:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:25039:x1871083729043328:12345-0@lo:501:mount.lustre.0 Request processed in 310us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405074.554968:0:25039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729043328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784405074.555006:0:25039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729043456:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784405074.555052:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405074.555078:0:25039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd541359480 going to sleep for 11 seconds 00000100:00100000:2.0:1784405074.555126:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784405074.555132:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729043456 00000100:00100000:0.0:1784405074.555137:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729043456 00000100:00100000:0.0:1784405074.555171:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784405074.555178:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:25039:x1871083729043456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784405074.555255:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:25039:x1871083729043456:12345-0@lo:503:mount.lustre.0 Request processed in 77us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405074.555271:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784405074.555332:0:25039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729043456:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784405074.556143:0:25039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784405074.556218:0:25039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729043584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784405074.556284:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405074.556324:0:25039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd541359480 going to sleep for 11 seconds 00000100:00100000:0.0:1784405074.559532:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729043584 00000100:00100000:0.0:1784405074.559547:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729043584 00000100:00100000:0.0:1784405074.559615:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784405074.559626:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:25039:x1871083729043584:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784405074.559967:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:25039:x1871083729043584:12345-0@lo:502:mount.lustre.0 Request processed in 343us (3682us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405074.559975:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784405074.560237:0:25039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729043584:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784405074.560525:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1784405074.560565:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1784405074.560579:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1784405074.561947:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1784405074.561976:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1784405074.561991:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1784405074.562005:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1784405074.562019:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1784405074.562033:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1784405074.562047:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1784405074.562178:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1784405074.562228:0:25039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729043712:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784405074.562371:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405074.562416:0:25039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd541359480 going to sleep for 11 seconds 00000100:00100000:0.0:1784405074.565535:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729043712 00000100:00100000:0.0:1784405074.565550:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729043712 00000100:00100000:0.0:1784405074.565619:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784405074.565629:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:25039:x1871083729043712:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784405074.565838:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:25039:x1871083729043712:12345-0@lo:502:mount.lustre.0 Request processed in 210us (3476us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405074.565846:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1784405074.565937:0:25039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729043712:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784405074.566019:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1784405074.566040:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1784405074.567900:0:25047:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784405074.567911:0:25047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784405074.567914:0:25047:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784405074.567919:0:25047:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd443141800 00000020:00000080:0.0:1784405074.567922:0:25047:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784405074.567929:0:25047:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784405074.567931:0:25047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784405074.567933:0:25047:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784405074.567935:0:25047:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784405074.567937:0:25047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784405074.567938:0:25047:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784405074.567941:0:25047:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dd443141800 00000020:00000080:0.0:1784405074.567943:0:25047:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784405074.568012:0:25047:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784405074.568016:0:25047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784405074.568017:0:25047:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1784405074.568020:0:25047:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784405074.568022:0:25047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784405074.568024:0:25047:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784405074.568027:0:25047:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd443141800 00000020:00000080:0.0:1784405074.568029:0:25047:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784405074.568057:0:25047:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784405074.568060:0:25047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784405074.568061:0:25047:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784405074.568064:0:25047:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784405074.568066:0:25047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784405074.568067:0:25047:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784405074.568070:0:25047:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dd443141800 00000020:00000080:0.0:1784405074.568072:0:25047:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784405074.568090:0:25047:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784405074.568093:0:25047:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784405074.568094:0:25047:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1784405074.568096:0:25047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1784405074.568268:0:25039:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1784405074.568293:0:25039:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784405074.568311:0:25039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd57331d200/0x24b3e2e6dcd7aad8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7aadf expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405074.568323:0:25039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd57331d200/0x24b3e2e6dcd7aad8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7aadf expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784405074.568383:0:25039:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784405074.568386:0:25039:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dd443141800 10000000:01000000:2.0:1784405074.568389:0:25039:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dd443141800 10000000:01000000:2.0:1784405074.568460:0:25039:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784405074.568467:0:25039:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9dd443141800 from 1 10000000:01000000:2.0:1784405074.568470:0:25039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784405074.568506:0:25039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7aae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405074.568515:0:25039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7aae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405074.568524:0:25039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7aae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405074.568550:0:25039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729043840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784405074.568616:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405074.568670:0:25039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4431653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784405074.568773:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729043840 00000100:00100000:3.0:1784405074.568780:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729043840 00000100:00100000:3.0:1784405074.568834:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784405074.568843:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:25039:x1871083729043840:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784405074.568873:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784405074.568886:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd58151b400/0x24b3e2e6dcd7aaed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7aae6 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405074.568909:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd58151b400/0x24b3e2e6dcd7aaed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7aae6 expref: 24 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405074.568918:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd58151b400/0x24b3e2e6dcd7aaed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7aae6 expref: 24 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405074.568927:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b400, rc 0) 00000100:00100000:3.0:1784405074.568964:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:25039:x1871083729043840:12345-0@lo:101:mount.lustre.0 Request processed in 123us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405074.568971:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784405074.571615:0:25039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729043840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784405074.571654:0:25039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7aae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7aaed expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405074.571667:0:25039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7aae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7aaed expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784405074.580416:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1784405074.580752:0:25039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784405074.580995:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1784405074.581021:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1784405074.581037:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1784405074.581068:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1784405074.581084:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1784405074.581098:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1784405074.581111:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1784405074.581124:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1784405074.581137:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1784405074.581150:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1784405074.581163:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1784405074.581176:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1784405074.581190:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1784405074.581202:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1784405074.581214:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1784405074.581241:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1784405074.581505:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1784405074.581520:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1784405074.581533:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1784405074.581546:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1784405074.581560:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1784405074.581573:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1784405074.581595:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1784405074.581609:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1784405074.581622:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1784405074.581634:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1784405074.581647:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1784405074.581659:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1784405074.581672:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1784405074.581685:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1784405074.581696:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1784405074.581722:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1784405074.581735:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1784405074.581748:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1784405074.581759:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1784405074.581772:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1784405074.581784:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1784405074.581797:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1784405074.581809:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1784405074.581821:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1784405074.581833:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1784405074.581846:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1784405074.581888:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1784405074.581902:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1784405074.581915:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1784405074.581927:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1784405074.581939:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1784405074.581964:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1784405074.583826:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1784405074.583900:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1784405074.583926:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1784405074.583932:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1784405074.584058:0:25039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729043968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784405074.584132:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405074.584191:0:25039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443165cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784405074.587595:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729043968 00000100:00100000:2.0:1784405074.587613:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729043968 00000100:00100000:2.0:1784405074.587685:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784405074.587696:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:25039:x1871083729043968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784405074.587903:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:25039:x1871083729043968:12345-0@lo:501:mount.lustre.0 Request processed in 209us (3769us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405074.587911:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784405074.587974:0:25039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729043968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784405074.588025:0:25039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729044096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784405074.588085:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405074.588111:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729044096 00000100:00100000:2.0:1784405074.588115:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729044096 00000100:00100000:2.0:1784405074.588140:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784405074.588147:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:25039:x1871083729044096:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784405074.588221:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:25039:x1871083729044096:12345-0@lo:503:mount.lustre.0 Request processed in 73us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405074.588228:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784405074.588273:0:25039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443165cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784405074.588286:0:25039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729044096:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784405074.592803:0:25039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784405074.592954:0:25039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729044224:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784405074.593046:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405074.598597:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729044224 00000100:00100000:2.0:1784405074.598612:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729044224 00000100:00100000:2.0:1784405074.598669:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784405074.598692:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:25039:x1871083729044224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784405074.598847:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:25039:x1871083729044224:12345-0@lo:502:mount.lustre.0 Request processed in 159us (5801us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405074.598872:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784405074.598928:0:25039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4431653c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784405074.598952:0:25039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729044224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784405074.599176:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1784405074.599201:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1784405074.599212:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1784405074.599222:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1784405074.599233:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1784405074.599243:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1784405074.599254:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1784405074.599265:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1784405074.599276:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1784405074.599286:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1784405074.599296:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1784405074.599318:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1784405074.599329:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1784405074.599339:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1784405074.599349:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1784405074.599359:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1784405074.599385:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1784405074.599395:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1784405074.599407:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1784405074.599417:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1784405074.600541:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1784405074.600566:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1784405074.600577:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1784405074.600589:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1784405074.600612:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1784405074.600623:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1784405074.600634:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1784405074.600658:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1784405074.600670:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1784405074.600682:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1784405074.600694:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1784405074.600705:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1784405074.600716:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1784405074.600727:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1784405074.600737:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1784405074.600747:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1784405074.600758:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1784405074.600768:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1784405074.600779:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1784405074.600789:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1784405074.600800:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1784405074.600810:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1784405074.600821:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1784405074.600842:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1784405074.600870:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1784405074.600882:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1784405074.600893:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1784405074.600904:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1784405074.600959:0:25039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729044352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784405074.601037:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405074.601058:0:25039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4431653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784405074.607884:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729044352 00000100:00100000:3.0:1784405074.607907:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729044352 00000100:00100000:3.0:1784405074.607966:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784405074.607977:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:25039:x1871083729044352:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784405074.608143:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:25039:x1871083729044352:12345-0@lo:502:mount.lustre.0 Request processed in 169us (7106us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405074.608151:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784405074.608743:0:25039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729044352:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784405074.609004:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1784405074.609035:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1784405074.609076:0:25039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729044480:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784405074.609133:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405074.609171:0:25039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4431653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784405074.609834:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729044480 00000100:00100000:3.0:1784405074.609841:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729044480 00000100:00100000:3.0:1784405074.609903:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784405074.609913:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:25039:x1871083729044480:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784405074.610034:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:25039:x1871083729044480:12345-0@lo:502:mount.lustre.0 Request processed in 122us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405074.610040:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784405074.613170:0:25039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729044480:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784405074.613629:0:25039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1784405074.613645:0:25039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1784405074.617375:0:25052:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784405074.617395:0:25052:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9dd573b199c0) 00000020:00000080:2.0:1784405074.617422:0:25052:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1784405074.617588:0:25052:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd443141800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784405074.617592:0:25052:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd443141800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784405074.617594:0:25052:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd443141800 3 00010000:00080000:2.0:1784405074.617621:0:25052:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd44224a000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.142@tcp at head 00010000:00010000:2.0:1784405074.619229:0:25052:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1784405074.619354:0:25052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1784405074.619406:0:25052:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784405074.619419:0:25052:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x24b3e2e6dcd7aafb 00000100:00080000:2.0:1784405074.619429:0:25052:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784405074.619434:0:25052:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dd44224a000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784405074.619471:0:25052:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443d86680 x1871083729044608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784405074.619502:0:25052:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784405074.619584:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784405074.619588:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784405074.619590:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd443585000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784405074.619594:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 690 00000100:00080000:2.0:1784405074.619596:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784405074.619600:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd443585000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784405074.619631:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443d86a00 x1871083729044992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784405074.619659:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784405074.619662:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784405074.619664:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784405074.619667:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 690 00000100:00080000:2.0:1784405074.619670:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784405074.619674:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd574d7e800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:2.0:1784405074.619685:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443d84380 x1871083729045504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784405074.620346:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083729044608:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784405074.620437:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405074.620486:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729044992:0@lo:8:kworker.0 00000100:00100000:0.0:1784405074.620515:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405074.620534:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729045504:0@lo:8:kworker.0 00000100:00100000:0.0:1784405074.620553:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405074.620589:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729044608 00000100:00100000:0.0:1784405074.620595:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729044608 00000100:00100000:0.0:1784405074.620625:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784405074.620632:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1871083729044608:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784405074.620664:0:22719:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:0.0:1784405074.620699:0:22719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x24b3e2e6dcd7ab02 00000004:00100000:0.0:1784405074.620714:0:22719:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784405074.620744:0:22719:0:(import.c:65:import_set_state_nolock()) ffff9dd55f146000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784405074.620793:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1871083729044608:12345-0@lo:38:llog_process_th.0 Request processed in 159us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405074.620800:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784405074.620824:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729044992 00000100:00100000:0.0:1784405074.620828:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729044992 00000100:00100000:0.0:1784405074.620845:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729045504 00000100:00100000:0.0:1784405074.620865:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729045504 00000100:00100000:0.0:1784405074.620885:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784405074.620890:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1871083729044992:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1784405074.620928:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1871083729044992:12345-0@lo:8:kworker.0 Request processed in 37us (411us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784405074.620935:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784405074.620947:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784405074.620951:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1871083729045504:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1784405074.620976:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1871083729045504:12345-0@lo:8:kworker.0 Request processed in 24us (422us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784405074.620981:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1784405074.621105:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd443d86680 x1871083729044608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784405084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784405074.621115:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784405074.621123:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1784405074.621130:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784405074.621134:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784405074.621143:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd44224a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784405074.621149:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1871083729044608:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784405074.621162:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784405074.621166:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd443585000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784405074.621169:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784405074.621171:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729044992:0@lo:8:kworker.0 00000100:00100000:0.0:1784405074.621178:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784405074.621180:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784405074.621182:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784405074.621185:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729045504:0@lo:8:kworker.0 00000100:00100000:3.0:1784405074.625431:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729044736:0@lo:400:kworker.0 00000100:00100000:3.0:1784405074.625516:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405074.625564:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729045376:0@lo:400:kworker.0 00000100:00100000:3.0:1784405074.625589:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405074.625625:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784405074.625633:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729045248:0@lo:400:kworker.0 00000100:00100000:3.0:1784405074.625655:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405074.625677:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083729045888:0@lo:400:kworker.0 00000100:00100000:3.0:1784405074.625701:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405074.625742:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729044864:0@lo:400:kworker.0 00000100:00100000:3.0:1784405074.625763:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405074.625781:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083729045632:0@lo:400:kworker.0 00000100:00100000:3.0:1784405074.625836:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405074.625936:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784405074.625944:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083729045120:0@lo:400:kworker.0 00000100:00100000:3.0:1784405074.625966:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405074.625984:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083729045760:0@lo:400:kworker.0 00000100:00100000:3.0:1784405074.626001:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405074.626030:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729044736 00000100:00100000:3.0:1784405074.626039:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729044736 00000100:00100000:3.0:1784405074.626078:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729045248 00000100:00100000:3.0:1784405074.626081:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729045248 00000100:00100000:3.0:1784405074.626097:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784405074.626105:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729044736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405074.626160:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729044736:12345-0@lo:400:kworker.0 Request processed in 56us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405074.626167:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784405074.626184:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784405074.626191:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729045248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405074.626218:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729045248:12345-0@lo:400:kworker.0 Request processed in 28us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405074.626225:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784405074.626243:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729045888 00000100:00100000:1.0:1784405074.626358:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729045376 00000100:00100000:1.0:1784405074.626373:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729045376 00000100:00100000:1.0:1784405074.626411:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729044864 00000100:00100000:1.0:1784405074.626414:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729044864 00000100:00100000:1.0:1784405074.626445:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784405074.626452:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729045376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405074.626487:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729045376:12345-0@lo:400:kworker.0 Request processed in 36us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405074.626494:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784405074.626507:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784405074.626513:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729044864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405074.626543:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729044864:12345-0@lo:400:kworker.0 Request processed in 30us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405074.626549:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784405074.627395:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729045632 00000100:00100000:1.0:1784405074.627403:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729045632 00000100:00100000:1.0:1784405074.627428:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729045120 00000100:00100000:1.0:1784405074.627431:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729045120 00000100:00100000:1.0:1784405074.627440:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729045760 00000100:00100000:1.0:1784405074.627443:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729045760 00000100:00100000:1.0:1784405074.627464:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784405074.627472:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083729045632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405074.627514:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083729045632:12345-0@lo:400:kworker.0 Request processed in 43us (1677us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405074.627520:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784405074.627531:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784405074.627536:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083729045120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405074.627572:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083729045120:12345-0@lo:400:kworker.0 Request processed in 36us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405074.627577:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784405074.627586:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784405074.627590:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083729045760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405074.627611:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083729045760:12345-0@lo:400:kworker.0 Request processed in 21us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405074.627616:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784405074.627713:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729045888 00000100:00100000:3.0:1784405074.627750:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784405074.627758:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083729045888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405074.627791:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083729045888:12345-0@lo:400:kworker.0 Request processed in 34us (2088us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405074.627807:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784405074.627883:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729045248:0@lo:400:kworker.0 00010000:00080000:3.0:1784405074.627898:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd443d85180 x1871083729045888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405074.627907:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083729045888:0@lo:400:kworker.0 00000100:00100000:3.0:1784405074.627917:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729044736:0@lo:400:kworker.0 00000100:00100000:3.0:1784405074.627929:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729045376:0@lo:400:kworker.0 00000100:00080000:3.0:1784405074.627955:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784405074.627959:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784405074.627962:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784405074.627977:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd443d87480 x1871083729045120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405074.627986:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083729045120:0@lo:400:kworker.0 00010000:00080000:3.0:1784405074.627994:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd443d84000 x1871083729045760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405074.628001:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083729045760:0@lo:400:kworker.0 00000100:00100000:3.0:1784405074.628012:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729044864:0@lo:400:kworker.0 00010000:00080000:3.0:1784405074.628021:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd443d86d80 x1871083729045632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405074.628029:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083729045632:0@lo:400:kworker.0 00000020:01000004:3.0:1784405074.629542:0:25052:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1784405074.629571:0:25052:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9dd545b90000) 00000020:00000080:3.0:1784405074.629597:0:25052:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1784405074.629799:0:25052:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dd443141800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784405074.629804:0:25052:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dd443141800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784405074.629807:0:25052:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dd443141800 3 00010000:00080000:3.0:1784405074.629841:0:25052:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dd4435a0800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.142@tcp at head 00010000:00010000:3.0:1784405074.637822:0:25052:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1784405074.637952:0:25052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1784405074.638002:0:25052:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784405074.638015:0:25052:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x24b3e2e6dcd7ab10 00000100:00080000:3.0:1784405074.638027:0:25052:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784405074.638034:0:25052:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9dd4435a0800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:3.0:1784405074.638075:0:25052:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd443cdf100 x1871083729046016/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784405074.638118:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1871083729046016:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784405074.638195:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405074.638755:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729046016 00000100:00100000:3.0:1784405074.638764:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729046016 00000100:00100000:3.0:1784405074.638798:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784405074.638805:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1871083729046016:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1784405074.638829:0:22719:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:3.0:1784405074.638889:0:22719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x24b3e2e6dcd7ab17 00000004:00100000:3.0:1784405074.638906:0:22719:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784405074.638935:0:22719:0:(import.c:65:import_set_state_nolock()) ffff9dd4435a5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784405074.638987:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1871083729046016:12345-0@lo:38:llog_process_th.0 Request processed in 181us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405074.638995:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1784405074.639037:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dd443cdf100 x1871083729046016/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784405084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405074.639048:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784405074.639054:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1784405074.639061:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784405074.639064:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784405074.639067:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd4435a0800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784405074.639072:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1871083729046016:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1784405074.639090:0:25052:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1784405074.639313:0:25052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1784405074.639521:0:25039:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1784405074.639552:0:25039:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784405074.639567:0:25039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7aae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7aaed expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.639577:0:25039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd4425c7600/0x24b3e2e6dcd7aae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7aaed expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784405074.639624:0:25039:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784405074.639626:0:25039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784405074.639627:0:25039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784405074.639628:0:25039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784405074.639630:0:25039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784405074.639631:0:25039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784405074.639632:0:25039:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784405074.639634:0:25039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784405074.639635:0:25039:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784405074.639639:0:25039:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1784405074.639642:0:25039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784405074.639643:0:25039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784405074.639648:0:25039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784405074.639649:0:25039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784405074.639650:0:25039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784405074.639651:0:25039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784405074.639652:0:25039:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784405074.639653:0:25039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784405074.639654:0:25039:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784405074.639671:0:25039:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1784405074.639688:0:25039:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729046144:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784405074.639732:0:25039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405074.639767:0:25039:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd4431650c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784405074.641527:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729046144 00000100:00100000:3.0:1784405074.641539:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729046144 00000100:00100000:3.0:1784405074.641592:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784405074.641601:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54a7b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:25039:x1871083729046144:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784405074.641632:0:22712:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1784405074.641644:0:22712:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784405074.661338:0:22712:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784405074.661401:0:22712:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1784405074.661706:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54a7b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:25039:x1871083729046144:12345-0@lo:253:mount.lustre.0 Request processed in 20102us (21968us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405074.661719:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784405074.661840:0:25039:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:25039:1871083729046144:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784405074.661885:0:25039:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784405074.661889:0:25039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784405074.661891:0:25039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784405074.661892:0:25039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784405074.661893:0:25039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784405074.661894:0:25039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784405074.661896:0:25039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784405074.661897:0:25039:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784405074.661899:0:25039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784405074.661900:0:25039:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784405074.661916:0:25039:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1784405074.664836:0:25039:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 20000000:01000000:0.0:1784405074.666166:0:22733:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784405074.666174:0:22733:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784405074.666197:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ab1e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.666216:0:22733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a9b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a9ab expref: 23 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.666223:0:22733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd442056600/0x24b3e2e6dcd7a9c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a9b9 expref: 23 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.666230:0:22733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ab1e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.666387:0:22733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd442056600/0x24b3e2e6dcd7a9c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a9b9 expref: 23 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.666401:0:22733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd442056600/0x24b3e2e6dcd7a9c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a9b9 expref: 23 pid: 22712 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405074.666416:0:22733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22733:1871083729046272:0@lo:104: 00000100:00100000:0.0:1784405074.666486:0:22733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784405074.666588:0:22733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a9b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a9ab expref: 23 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.666596:0:22733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a9b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a9ab expref: 23 pid: 22712 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405074.666605:0:22733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22733:1871083729046400:0@lo:104: 00000100:00100000:0.0:1784405074.666628:0:22733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405074.666817:0:22733:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551389840 going to sleep for 11 seconds 00000100:00100000:2.0:1784405074.667507:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729046272 00000100:00100000:2.0:1784405074.667516:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729046272 00000100:00100000:2.0:1784405074.667558:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729046400 00000100:00100000:2.0:1784405074.667561:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729046400 00000100:00100000:2.0:1784405074.667575:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784405074.667584:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+4:22733:x1871083729046272:12345-0@lo:104: 00010000:00010000:2.0:1784405074.667601:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd443549c00/0x24b3e2e6dcd7a9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a9c0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405074.667695:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784405074.667701:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+4:22733:x1871083729046272:12345-0@lo:104: Request processed in 119us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405074.667720:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784405074.667740:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784405074.667746:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+3:22733:x1871083729046400:12345-0@lo:104: 00010000:00010000:2.0:1784405074.667753:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a9b2 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405074.667788:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784405074.667793:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+3:22733:x1871083729046400:12345-0@lo:104: Request processed in 48us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405074.667800:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1784405074.667880:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784405074.667889:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd443549c00/0x24b3e2e6dcd7a9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a9c0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405074.667896:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443549c00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1784405074.667901:0:22706:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd443549c00/0x24b3e2e6dcd7a9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a9c0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405074.667910:0:22706:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd443549c00/0x24b3e2e6dcd7a9b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a9c0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784405074.667917:0:22706:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd443549c00/0x24b3e2e6dcd7a9b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a9c0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784405074.667928:0:22706:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784405074.667967:0:22706:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd443549c00/0x24b3e2e6dcd7a9b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a9c0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405074.667973:0:22706:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784405074.667993:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd443549c00/0x24b3e2e6dcd7a9b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a9c0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405074.668000:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd443549c00/0x24b3e2e6dcd7a9b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a9c0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405074.668011:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784405074.668014:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a9b2 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405074.668019:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd443549600 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:3.0:1784405074.668022:0:22706:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a9b2 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405074.668028:0:22706:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a9ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a9b2 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784405074.668034:0:22706:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a9ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a9b2 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784405074.668038:0:22706:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784405074.668060:0:22706:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a9ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a9b2 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405074.668065:0:22706:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784405074.668085:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a9ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a9b2 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405074.668091:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd443549600/0x24b3e2e6dcd7a9ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a9b2 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405074.668103:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405074.668105:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405074.668107:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405074.668113:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784405074.668124:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3647:1871083729046528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784405074.668158:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405074.668199:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3648:1871083729046656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784405074.668216:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405074.668522:0:22733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22733:1871083729046272:0@lo:104: 00000100:00100000:0.0:1784405074.668533:0:22733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22733:1871083729046400:0@lo:104: 00010000:00010000:0.0:1784405074.668554:0:22733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ab1e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405074.668577:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729046528 00000100:00100000:0.0:1784405074.668581:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729046528 00010000:00010000:0.0:1784405074.668599:0:22702:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd442056600/0x24b3e2e6dcd7a9c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a9b9 expref: 24 pid: 22712 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405074.668629:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729046656 00000100:00100000:0.0:1784405074.668632:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729046656 00010000:00010000:0.0:1784405074.668643:0:22702:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a9b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a9ab expref: 25 pid: 22712 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405074.668656:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784405074.668663:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+25:3647:x1871083729046528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784405074.668683:0:22702:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784405074.668689:0:22702:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd442056600/0x24b3e2e6dcd7a9c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a9b9 expref: 25 pid: 22712 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.668710:0:22702:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd442056600/0x24b3e2e6dcd7a9c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a9b9 expref: 25 pid: 22712 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.668723:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd442056600/0x24b3e2e6dcd7a9c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a9b9 expref: 25 pid: 22712 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.668736:0:22702:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784405074.668777:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:3647:x1871083729046528:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405074.668784:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784405074.668799:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784405074.668804:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:3648:x1871083729046656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784405074.668811:0:22702:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784405074.668816:0:22702:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a9b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a9ab expref: 23 pid: 22712 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.668824:0:22702:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a9b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a9ab expref: 23 pid: 22712 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.668834:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd442057800/0x24b3e2e6dcd7a9b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a9ab expref: 23 pid: 22712 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.668844:0:22702:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ab1e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.668878:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ab1e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784405074.668891:0:22702:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007351143s 00010000:00010000:0.0:1784405074.668901:0:22702:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ab1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.668908:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ab1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.668915:0:22702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ab1e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.668921:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ab1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.668927:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821db600 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:0.0:1784405074.668931:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ab1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.668938:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ab1e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.668953:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ab1e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.668962:0:22702:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784405074.668991:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+22:3648:x1871083729046656:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405074.668998:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784405074.669028:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3648:1871083729046656:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784405074.669044:0:22733:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ab1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.669064:0:22733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ab1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405074.669077:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ab1e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405074.669282:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3647:1871083729046528:0@lo:103:ldlm_bl.0 00002000:00080000:1.0:1784405074.672590:0:25039:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1784405074.672600:0:25039:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1784405074.672635:0:25039:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784405074.672731:0:25039:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.142@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784405074.672750:0:25039:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1784405074.672768:0:25039:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1784405074.683069:0:25039:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784405074.683337:0:25039:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784405074.960973:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784405075.554769:0:25105:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784405075.555560:0:25105:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1784405075.971188:0:22714:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784405075.971196:0:22714:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd54851a800 from 14 10000000:01000000:0.0:1784405075.971202:0:22714:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784405075.971267:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd7ab25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405075.971278:0:22714:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd7ab25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405075.971289:0:22714:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd7ab25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405075.971315:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729046784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784405075.971398:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405075.971442:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551389c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784405075.971947:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729046784 00000100:00100000:2.0:1784405075.971955:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729046784 00000100:00100000:2.0:1784405075.972014:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784405075.972025:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54a7b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+22:22714:x1871083729046784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784405075.972046:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784405075.972062:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd4425c7c00/0x24b3e2e6dcd7ab2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7ab25 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405075.972087:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd4425c7c00/0x24b3e2e6dcd7ab2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7ab25 expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405075.972107:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd4425c7c00/0x24b3e2e6dcd7ab2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7ab25 expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405075.972116:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd4425c7c00, rc 0) 00000100:00100000:2.0:1784405075.972165:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54a7b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:22714:x1871083729046784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405075.972188:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784405075.972498:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729046784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784405075.972520:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd7ab25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7ab2c expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405075.972529:0:22714:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd7ab25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7ab2c expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405075.972587:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729046912:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784405075.972626:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405075.972658:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551389c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784405075.975527:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729046912 00000100:00100000:2.0:1784405075.975543:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729046912 00000100:00100000:2.0:1784405075.975617:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784405075.975627:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54a7b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:22714:x1871083729046912:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784405075.975653:0:22712:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784405075.975675:0:22712:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784405075.975678:0:22712:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1784405075.975829:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54a7b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:22714:x1871083729046912:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 203us (3201us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405075.975838:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784405075.976118:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729046912:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784405075.976187:0:22714:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784405075.976198:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd7ab25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7ab2c expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405075.976208:0:22714:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd5821daa00/0x24b3e2e6dcd7ab25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7ab2c expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784405075.976216:0:22714:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784405075.976218:0:22714:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9dd442282800 from 14 10000000:01000000:0.0:1784405075.976221:0:22714:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784405075.976450:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd7ab33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405075.976459:0:22714:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd7ab33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405075.976468:0:22714:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd7ab33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405075.976488:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729047040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784405075.976523:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405075.976556:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551389c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784405075.976572:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729047040 00000100:00100000:0.0:1784405075.976576:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729047040 00000100:00100000:0.0:1784405075.976607:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784405075.976614:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54a7b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:22714:x1871083729047040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784405075.976625:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405075.976642:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd5821db000/0x24b3e2e6dcd7ab3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7ab33 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405075.976662:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd5821db000/0x24b3e2e6dcd7ab3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7ab33 expref: 24 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405075.976673:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd5821db000/0x24b3e2e6dcd7ab3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7ab33 expref: 24 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405075.976681:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd5821db000, rc 0) 00000100:00100000:0.0:1784405075.976711:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54a7b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:22714:x1871083729047040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405075.976717:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784405075.976914:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729047040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784405075.976927:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd7ab33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7ab3a expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405075.976936:0:22714:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd7ab33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7ab3a expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405075.976979:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729047168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784405075.977009:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405075.977023:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd551389c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784405075.977048:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729047168 00000100:00100000:0.0:1784405075.977051:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729047168 00000100:00100000:0.0:1784405075.977074:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784405075.977080:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54a7b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:22714:x1871083729047168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784405075.979364:0:22711:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784405075.979397:0:22711:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784405075.979401:0:22711:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1784405075.979555:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54a7b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:22714:x1871083729047168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2470us (2541us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405075.979566:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784405075.979821:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729047168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784405075.979920:0:22714:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784405075.979930:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd7ab33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7ab3a expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405075.979941:0:22714:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd5821dba00/0x24b3e2e6dcd7ab33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7ab3a expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405075.980655:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784405076.357082:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784405076.357120:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729047296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784405076.357202:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405076.357526:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729047296 00000100:00100000:1.0:1784405076.357535:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729047296 00000100:00100000:1.0:1784405076.357614:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784405076.357626:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729047296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784405076.357659:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1784405076.357708:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729047296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405076.357715:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1784405076.357771:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784405076.357925:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729047296:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784405077.002022:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784405077.379306:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729047424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784405077.379387:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405077.379447:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729047424 00000100:00100000:3.0:1784405077.379455:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729047424 00000100:00100000:3.0:1784405077.379494:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784405077.379502:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729047424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784405077.379534:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1784405077.379572:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729047424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405077.379579:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784405077.379638:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729047424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784405077.380303:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729047552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784405077.380349:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405077.381533:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729047552 00000100:00100000:1.0:1784405077.381539:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729047552 00000100:00100000:1.0:1784405077.381592:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784405077.381601:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729047552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784405077.381621:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1784405077.381677:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729047552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405077.381685:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784405077.381703:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784405077.381715:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729047680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784405077.381747:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784405077.381774:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784405077.381816:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729047552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784405077.381838:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729047680 00000100:00100000:1.0:1784405077.381841:0:23457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729047680 00000100:00100000:1.0:1784405077.381895:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784405077.381901:0:23457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729047680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784405077.381924:0:23457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784405077.381964:0:23457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729047680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405077.381970:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784405077.382000:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729047680:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784405078.020092:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405079.044222:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784405079.367425:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784405079.944713:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3649:1871083729047808:0@lo:400:kworker.0 00000100:00100000:2.0:1784405079.944797:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784405079.945046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784405079.945051:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784405079.945054:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd443585000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784405079.945063:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dd443585000 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784405079.945084:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd57c929f80 x1871083729048192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784405079.945153:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729047808 00000100:00100000:0.0:1784405079.945160:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729047808 00000100:00100000:0.0:1784405079.945206:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1784405079.945215:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54a7b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:3649:x1871083729047808:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784405079.949115:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784405079.949122:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784405079.949125:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784405079.949136:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dd574d7e800 using connection 192.168.202.142@tcp/0@lo 00000100:00100000:1.0:1784405079.949157:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dd57c929880 x1871083729048704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784405079.949217:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083729048320:0@lo:400:kworker.0 00000100:00100000:1.0:1784405079.949280:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405079.949330:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083729048960:0@lo:400:kworker.0 00000100:00100000:1.0:1784405079.949353:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405079.949380:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784405079.949387:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729048448:0@lo:400:kworker.0 00000100:00100000:1.0:1784405079.949411:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405079.949437:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083729049088:0@lo:400:kworker.0 00000100:00100000:1.0:1784405079.949472:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405079.949630:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729048064:0@lo:400:kworker.0 00000100:00100000:1.0:1784405079.949658:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405079.949676:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083729048832:0@lo:400:kworker.0 00000100:00100000:1.0:1784405079.949696:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405079.949713:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083729049344:0@lo:400:kworker.0 00000100:00100000:1.0:1784405079.949736:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405079.949748:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784405079.949754:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729047936:0@lo:400:kworker.0 00000100:00100000:1.0:1784405079.949777:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405079.949795:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729048576:0@lo:400:kworker.0 00000100:00100000:1.0:1784405079.949815:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405079.949831:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083729049216:0@lo:400:kworker.0 00000100:00100000:1.0:1784405079.949876:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405079.949898:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729048192:0@lo:8:kworker.0 00000100:00100000:1.0:1784405079.949921:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405079.950014:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729048704:0@lo:8:kworker.0 00000100:00100000:1.0:1784405079.950037:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405079.950070:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729048320 00000100:00100000:1.0:1784405079.950078:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729048320 00000100:00100000:1.0:1784405079.950112:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729048960 00000100:00100000:1.0:1784405079.950114:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729048960 00000100:00100000:1.0:1784405079.950135:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729049088 00000100:00100000:1.0:1784405079.950137:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729049088 00000100:00100000:1.0:1784405079.950148:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729048832 00000100:00100000:1.0:1784405079.950156:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729048832 00000100:00100000:1.0:1784405079.950169:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729049344 00000100:00100000:1.0:1784405079.950172:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729049344 00000100:00100000:1.0:1784405079.950182:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729049216 00000100:00100000:1.0:1784405079.950184:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729049216 00000100:00100000:1.0:1784405079.950197:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784405079.950205:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083729048320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405079.950253:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083729048320:12345-0@lo:400:kworker.0 Request processed in 48us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405079.950260:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784405079.950276:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784405079.950283:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083729048960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405079.950334:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083729048960:12345-0@lo:400:kworker.0 Request processed in 51us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405079.950340:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784405079.950352:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784405079.950358:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083729049088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405079.950384:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083729049088:12345-0@lo:400:kworker.0 Request processed in 27us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405079.950389:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784405079.950399:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784405079.950404:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083729048832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405079.950431:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083729048832:12345-0@lo:400:kworker.0 Request processed in 27us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405079.950436:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784405079.950447:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784405079.950635:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54a7b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:3649:x1871083729047808:12345-0@lo:400:kworker.0 Request processed in 5419us (5834us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405079.950644:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784405079.950700:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083729049344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405079.950736:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083729049344:12345-0@lo:400:kworker.0 Request processed in 38us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405079.953578:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3649:1871083729047808:0@lo:400:kworker.0 00000100:00080000:2.0:1784405079.954015:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784405079.954031:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784405079.954050:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729048064 00000100:00100000:2.0:1784405079.954058:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729048064 00000100:00100000:2.0:1784405079.954105:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729048576 00000100:00100000:2.0:1784405079.954108:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729048576 00000100:00100000:2.0:1784405079.954122:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729048192 00000100:00100000:2.0:1784405079.954125:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729048192 00000100:00100000:2.0:1784405079.954133:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729048704 00000100:00100000:2.0:1784405079.954135:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729048704 00000100:00100000:2.0:1784405079.954149:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784405079.954157:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729048064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405079.954239:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729048064:12345-0@lo:400:kworker.0 Request processed in 82us (4579us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405079.954246:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784405079.954261:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784405079.954266:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729048576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405079.954289:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729048576:12345-0@lo:400:kworker.0 Request processed in 24us (4475us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405079.954294:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784405079.954303:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784405079.954307:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1871083729048192:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1784405079.954343:0:24225:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 697 last 0 00000020:00000080:2.0:1784405079.954368:0:24225:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x24b3e2e6dcd7ab41 00002000:00100000:2.0:1784405079.954380:0:24225:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9dd44224b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ae ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1784405079.954384:0:24225:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1784405079.954386:0:24225:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784405079.954913:0:24225:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784405079.955037:0:24225:0:(import.c:65:import_set_state_nolock()) ffff9dd442249800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784405079.955092:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1871083729048192:12345-0@lo:8:kworker.0 Request processed in 783us (5169us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405079.955100:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784405079.955114:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784405079.955119:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1871083729048704:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1784405079.955134:0:24225:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 697 last 0 00000020:00000080:2.0:1784405079.955152:0:24225:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x24b3e2e6dcd7ab48 00002000:00100000:2.0:1784405079.955159:0:24225:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9dd442248000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ae ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1784405079.955163:0:24225:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1784405079.955165:0:24225:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784405079.955188:0:24225:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1784405079.955198:0:24225:0:(import.c:65:import_set_state_nolock()) ffff9dd44224a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784405079.955221:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1871083729048704:12345-0@lo:8:kworker.0 Request processed in 102us (5184us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405079.955227:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784405079.955252:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729048448 00000100:00100000:2.0:1784405079.955257:0:23457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729048448 00000100:00100000:2.0:1784405079.955282:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729047936 00000100:00100000:2.0:1784405079.955284:0:23457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729047936 00000100:00100000:2.0:1784405079.955294:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784405079.955300:0:23457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729048448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405079.955346:0:23457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729048448:12345-0@lo:400:kworker.0 Request processed in 46us (5934us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405079.955352:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784405079.955362:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784405079.955367:0:23457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729047936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405079.955389:0:23457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729047936:12345-0@lo:400:kworker.0 Request processed in 23us (5612us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405079.955400:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1784405079.955574:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c929f80 x1871083729048192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784405104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784405079.955591:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1784405079.955597:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784405079.955602:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1784405079.955605:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd443585000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784405079.955618:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784405079.955623:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1871083729048192:0@lo:8:kworker.0 00010000:00080000:3.0:1784405079.955637:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c929880 x1871083729048704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784405104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784405079.955647:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1784405079.955651:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784405079.955654:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1784405079.955655:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9dd574d7e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784405079.955666:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784405079.955669:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1871083729048704:0@lo:8:kworker.0 00000004:00080000:3.0:1784405079.955722:0:22744:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1784405079.955743:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22744:1871083729049600:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784405079.955779:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405079.955803:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd570601840 going to sleep for 11 seconds 00000004:00080000:3.0:1784405079.955817:0:23460:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784405079.955899:0:23460:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 697840047097ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784405079.955905:0:23460:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1784405079.956228:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784405079.956242:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083729049216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405079.956281:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083729049216:12345-0@lo:400:kworker.0 Request processed in 45us (6405us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405079.956287:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784405079.956327:0:24642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729049600 00000100:00100000:0.0:1784405079.956331:0:24642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729049600 00000100:00100000:0.0:1784405079.956352:0:24642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784405079.956357:0:24642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22744:x1871083729049600:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784405079.956766:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784405079.956778:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729049472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784405079.956814:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784405079.956896:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784405079.956900:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784405079.956961:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729049472 00000100:00100000:0.0:1784405079.956965:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729049472 00000100:00100000:0.0:1784405079.956991:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784405079.956997:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1871083729049472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784405079.957014:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784405079.957053:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1871083729049472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405079.957059:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1784405079.957165:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443cdf100 x1871083729049472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784405095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784405079.957182:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729049472:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1784405079.957903:0:22743:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784405079.957979:0:22743:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697842126940ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784405079.957985:0:22743:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00002000:00080000:0.0:1784405079.960398:0:24642:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1784405079.960408:0:24642:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:0.0:1784405079.960413:0:24642:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00000004:00080000:3.0:1784405079.962128:0:23461:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1784405079.962162:0:23461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23461:1871083729049856:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1784405079.962240:0:23461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405079.962283:0:23461:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd570601b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784405079.962307:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729049728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784405079.962344:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405079.962492:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784405079.962554:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729047936:0@lo:400:kworker.0 00000100:00100000:1.0:1784405079.962569:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729048576:0@lo:400:kworker.0 00010000:00080000:1.0:1784405079.962584:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c928000 x1871083729049216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405079.962595:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083729049216:0@lo:400:kworker.0 00000100:00100000:1.0:1784405079.962607:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729048064:0@lo:400:kworker.0 00010000:00080000:1.0:1784405079.962618:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c92bb80 x1871083729048832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405079.962628:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083729048832:0@lo:400:kworker.0 00010000:00080000:1.0:1784405079.962640:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c929c00 x1871083729049344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405079.962648:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083729049344:0@lo:400:kworker.0 00000100:00100000:1.0:1784405079.962686:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729048448:0@lo:400:kworker.0 00010000:00080000:1.0:1784405079.962697:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c928a80 x1871083729049088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405079.962704:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083729049088:0@lo:400:kworker.0 00010000:00080000:1.0:1784405079.962715:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c928700 x1871083729048320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405079.962743:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083729048320:0@lo:400:kworker.0 00010000:00080000:1.0:1784405079.962756:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c92b100 x1871083729048960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405079.962764:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083729048960:0@lo:400:kworker.0 00000100:00100000:1.0:1784405079.966238:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729049856 00000100:00100000:1.0:1784405079.966251:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729049856 00000100:00100000:1.0:1784405079.966310:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784405079.966331:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23461:x1871083729049856:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:1.0:1784405079.968554:0:24224:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1784405079.968564:0:24224:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1784405079.968656:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23461:x1871083729049856:12345-0@lo:7:osp-pre-1-1.0 Request processed in 2323us (6412us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405079.968667:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1784405079.968698:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1784405079.968734:0:23448:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00080000:2.0:1784405079.969064:0:23461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c929880 x1871083729049856/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784405095 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784405079.969081:0:23461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23461:1871083729049856:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1784405079.969093:0:23461:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1784405079.969130:0:23461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d84000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23461:1871083729049984:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1784405079.969163:0:23461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405079.969187:0:23461:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548576cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784405079.969265:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729049984 00000100:00100000:1.0:1784405079.969271:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729049984 00000100:00100000:1.0:1784405079.969300:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784405079.969308:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23461:x1871083729049984:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1784405079.969340:0:24222:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1784405079.969368:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23461:x1871083729049984:12345-0@lo:5:osp-pre-1-1.0 Request processed in 61us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405079.969374:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784405079.970066:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729049728 00000100:00100000:1.0:1784405079.970072:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729049728 00000100:00100000:1.0:1784405079.970100:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784405079.970117:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1871083729049728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784405079.970132:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784405079.970172:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1871083729049728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (7828us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405079.970179:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1784405079.970207:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443cdf100 x1871083729049728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784405095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405079.970224:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729049728:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1784405079.970288:0:23461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443d84000 x1871083729049984/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784405095 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784405079.970298:0:23461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d84000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23461:1871083729049984:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1784405079.970306:0:23461:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1784405079.970346:0:23461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d84000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23461:1871083729050112:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1784405079.970369:0:23461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405079.970389:0:23461:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd548576cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784405079.971151:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729050112 00000100:00100000:1.0:1784405079.971157:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729050112 00000100:00100000:1.0:1784405079.971185:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784405079.971191:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23461:x1871083729050112:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1784405079.971222:0:24222:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000004:00080000:2.0:1784405079.975363:0:22696:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1784405079.985167:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784405079.985180:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7ab4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.985198:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1784405079.985203:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784405079.985210:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7ab4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.985227:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7ab4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.985238:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7ab4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.985253:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7ab4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.985279:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784405079.986275:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784405079.986282:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7ab56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.986295:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1784405079.986299:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784405079.986304:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7ab56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.986326:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7ab56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.986335:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7ab56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.986343:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7ab56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.986358:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784405079.986473:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784405079.986479:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7ab4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.986492:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331c800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784405079.986497:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7ab4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.986507:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7ab4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.986524:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7ab4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.986532:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7ab4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.986550:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784405079.986554:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7ab56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.986560:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331de00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784405079.986562:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7ab56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.986570:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7ab56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.986579:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7ab56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.986593:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7ab56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.986606:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405079.986608:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405079.986609:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784405079.989967:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784405079.989984:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7ab5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.990012:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1784405079.990018:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784405079.990025:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7ab5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.990040:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7ab5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.990051:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7ab5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.990059:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7ab5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.990080:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784405079.990310:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784405079.990331:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7ab5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.990339:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331c200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784405079.990344:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7ab5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.990352:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7ab5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.990370:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7ab5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.990377:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7ab5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405079.990395:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405079.990397:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405079.990399:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784405079.995784:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784405079.995801:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7ab64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405079.995820:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1784405079.995825:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784405079.995833:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7ab64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405079.995885:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7ab64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405079.995897:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7ab64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405079.995904:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7ab64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405079.995925:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784405079.996549:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784405079.996556:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001386a90f/0x24b3e2e6dcd7ab6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405079.996566:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1784405079.996570:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784405079.996574:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001386a90f/0x24b3e2e6dcd7ab6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405079.996584:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001386a90f/0x24b3e2e6dcd7ab6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405079.996592:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001386a90f/0x24b3e2e6dcd7ab6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405079.996610:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001386a90f/0x24b3e2e6dcd7ab6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405079.996626:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1784405079.996897:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784405079.996903:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a2aae9d/0x24b3e2e6dcd7ab72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405079.996913:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1784405079.996916:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784405079.996921:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a2aae9d/0x24b3e2e6dcd7ab72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.997143:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784405079.997152:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7ab64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.997161:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c7400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784405079.997165:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7ab64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.997175:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7ab64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.997208:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7ab64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.997217:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059d1d8d7/0x24b3e2e6dcd7ab64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.997234:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784405079.997238:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001386a90f/0x24b3e2e6dcd7ab6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.997245:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784405079.997248:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001386a90f/0x24b3e2e6dcd7ab6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.997256:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001386a90f/0x24b3e2e6dcd7ab6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.997266:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001386a90f/0x24b3e2e6dcd7ab6b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.997274:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001386a90f/0x24b3e2e6dcd7ab6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.997287:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405079.997289:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405079.997295:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405079.997414:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a2aae9d/0x24b3e2e6dcd7ab72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405079.997425:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a2aae9d/0x24b3e2e6dcd7ab72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405079.997432:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a2aae9d/0x24b3e2e6dcd7ab72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405079.997524:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784405079.998732:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784405079.998742:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf5d446e/0x24b3e2e6dcd7ab79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405079.998763:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1784405079.998766:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784405079.998772:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf5d446e/0x24b3e2e6dcd7ab79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405079.998785:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf5d446e/0x24b3e2e6dcd7ab79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405079.998794:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf5d446e/0x24b3e2e6dcd7ab79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405079.998801:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf5d446e/0x24b3e2e6dcd7ab79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405079.998812:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784405079.999569:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784405079.999581:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a2aae9d/0x24b3e2e6dcd7ab72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.999592:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784405079.999597:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a2aae9d/0x24b3e2e6dcd7ab72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.999606:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a2aae9d/0x24b3e2e6dcd7ab72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.999623:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a2aae9d/0x24b3e2e6dcd7ab72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.999631:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a2aae9d/0x24b3e2e6dcd7ab72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.999653:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784405079.999658:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf5d446e/0x24b3e2e6dcd7ab79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.999664:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056600 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784405079.999667:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf5d446e/0x24b3e2e6dcd7ab79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.999675:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf5d446e/0x24b3e2e6dcd7ab79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.999695:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf5d446e/0x24b3e2e6dcd7ab79 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.999702:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf5d446e/0x24b3e2e6dcd7ab79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405079.999715:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405079.999717:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405079.999718:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784405080.000350:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784405080.000359:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7ab80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.000371:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1784405080.000375:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784405080.000380:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7ab80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.000391:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7ab80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.000413:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7ab80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.000421:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7ab80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.000445:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784405080.000612:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784405080.000617:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7ab80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.000625:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057e00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784405080.000629:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7ab80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.000637:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7ab80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.000649:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7ab80 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.000657:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7ab80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.000671:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405080.000679:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405080.000680:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405080.000716:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.002718:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784405080.003987:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784405080.003999:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fecd369/0x24b3e2e6dcd7ab87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.004025:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1784405080.004030:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784405080.004036:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fecd369/0x24b3e2e6dcd7ab87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.004059:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fecd369/0x24b3e2e6dcd7ab87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.004069:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fecd369/0x24b3e2e6dcd7ab87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.004076:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fecd369/0x24b3e2e6dcd7ab87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.004094:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784405080.004280:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784405080.004286:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fecd369/0x24b3e2e6dcd7ab87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.004294:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331ca00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784405080.004299:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fecd369/0x24b3e2e6dcd7ab87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.004308:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fecd369/0x24b3e2e6dcd7ab87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.004337:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fecd369/0x24b3e2e6dcd7ab87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.004344:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fecd369/0x24b3e2e6dcd7ab87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.004369:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.004371:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.004373:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784405080.004832:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784405080.004839:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ce4ad86/0x24b3e2e6dcd7ab8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.004848:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1784405080.004879:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784405080.004883:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ce4ad86/0x24b3e2e6dcd7ab8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.004894:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ce4ad86/0x24b3e2e6dcd7ab8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.004902:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ce4ad86/0x24b3e2e6dcd7ab8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.004909:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ce4ad86/0x24b3e2e6dcd7ab8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.004924:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784405080.004997:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784405080.005010:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ce4ad86/0x24b3e2e6dcd7ab8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.005019:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331d400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784405080.005023:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ce4ad86/0x24b3e2e6dcd7ab8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.005030:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ce4ad86/0x24b3e2e6dcd7ab8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.005040:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ce4ad86/0x24b3e2e6dcd7ab8e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.005049:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405080.005050:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405080.005052:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.005190:0:24642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ce4ad86/0x24b3e2e6dcd7ab8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784405080.005545:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784405080.005556:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022145675/0x24b3e2e6dcd7ab95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.005564:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1784405080.005567:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784405080.005571:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022145675/0x24b3e2e6dcd7ab95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.005579:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022145675/0x24b3e2e6dcd7ab95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.005587:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022145675/0x24b3e2e6dcd7ab95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.005592:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022145675/0x24b3e2e6dcd7ab95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.005608:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784405080.006068:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784405080.006075:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f460829/0x24b3e2e6dcd7ab9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006084:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1784405080.006087:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784405080.006092:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f460829/0x24b3e2e6dcd7ab9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006102:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f460829/0x24b3e2e6dcd7ab9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006116:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f460829/0x24b3e2e6dcd7ab9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006123:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f460829/0x24b3e2e6dcd7ab9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006148:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784405080.006233:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784405080.006238:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022145675/0x24b3e2e6dcd7ab95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006246:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331c600 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784405080.006250:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022145675/0x24b3e2e6dcd7ab95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006258:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022145675/0x24b3e2e6dcd7ab95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006272:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022145675/0x24b3e2e6dcd7ab95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006280:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022145675/0x24b3e2e6dcd7ab95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006295:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784405080.006305:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f460829/0x24b3e2e6dcd7ab9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006312:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331c400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784405080.006327:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f460829/0x24b3e2e6dcd7ab9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006336:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f460829/0x24b3e2e6dcd7ab9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006348:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f460829/0x24b3e2e6dcd7ab9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006355:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f460829/0x24b3e2e6dcd7ab9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006368:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.006370:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.006371:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405080.006411:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784405080.006808:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784405080.006814:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb852d27/0x24b3e2e6dcd7aba3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006824:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1784405080.006828:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784405080.006831:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb852d27/0x24b3e2e6dcd7aba3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006879:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb852d27/0x24b3e2e6dcd7aba3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006889:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb852d27/0x24b3e2e6dcd7aba3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006897:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb852d27/0x24b3e2e6dcd7aba3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.006914:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784405080.007301:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784405080.007310:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb852d27/0x24b3e2e6dcd7aba3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.007330:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331d800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784405080.007334:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb852d27/0x24b3e2e6dcd7aba3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.007341:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb852d27/0x24b3e2e6dcd7aba3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.007355:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb852d27/0x24b3e2e6dcd7aba3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.007361:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb852d27/0x24b3e2e6dcd7aba3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.007388:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405080.007390:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405080.007392:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784405080.007751:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405080.007757:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.007767:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1784405080.007771:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405080.007775:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.007786:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.007793:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.007799:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.007814:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784405080.008237:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405080.008243:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.008262:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1784405080.008265:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405080.008270:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.008279:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.008288:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.008296:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.008309:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784405080.008329:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784405080.008334:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.008340:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784405080.008344:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.008353:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.008374:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abaa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.008380:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abaa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.008392:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784405080.008395:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.008402:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151be00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784405080.008405:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.008412:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.008419:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abb1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.008425:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.008434:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405080.008436:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405080.008442:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.008969:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784405080.009884:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784405080.009893:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7abb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.009906:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1784405080.009910:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784405080.009916:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7abb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.009926:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7abb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.009946:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7abb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.009964:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7abb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.009981:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784405080.011340:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784405080.011350:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7abbf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.011364:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1784405080.011368:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784405080.011374:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7abbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.011385:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7abbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.011394:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7abbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.011403:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7abbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.011425:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784405080.011438:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784405080.011442:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7abb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.011656:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784405080.011662:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7abbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.011669:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331de00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784405080.011674:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7abbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.011682:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7abbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.011697:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7abbf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.011706:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eeaf5bfc/0x24b3e2e6dcd7abbf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.011725:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405080.011727:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405080.011728:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.012280:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331c200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784405080.012284:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7abb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.012292:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7abb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.012305:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7abb8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.012312:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c47de0e/0x24b3e2e6dcd7abb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.012342:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.012344:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.012346:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784405080.014120:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784405080.014132:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7abc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.014151:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=697s v=(0 0) 00010000:00010000:1.0:1784405080.014156:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784405080.014163:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7abc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.014178:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7abc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.014196:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7abc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.014204:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7abc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.014227:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784405080.014241:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784405080.014247:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7abc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.014256:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331c800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784405080.014261:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7abc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.014270:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7abc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.014286:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7abc6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.014295:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d6bb76e/0x24b3e2e6dcd7abc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.014323:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.014330:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.014332:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784405080.025728:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405080.025739:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abcd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.025758:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1784405080.025763:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405080.025769:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.025791:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.025801:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.025809:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.025827:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784405080.025839:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784405080.025844:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.025900:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784405080.025905:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.025913:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.025928:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abcd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.027625:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abcd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.027655:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405080.027657:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405080.027659:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784405080.028128:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784405080.028137:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7abd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.028149:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1784405080.028153:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784405080.028159:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7abd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.028184:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7abd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.028193:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7abd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.028200:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7abd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.028224:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784405080.028392:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784405080.028399:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7abd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.028406:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057e00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784405080.028410:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7abd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.028418:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7abd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.028436:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7abd4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.028442:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8ac5db3/0x24b3e2e6dcd7abd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.028522:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405080.028588:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405080.028590:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784405080.032207:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405080.032221:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abdb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.032252:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1784405080.032257:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405080.032264:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.032280:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.032291:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.032298:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.032334:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784405080.033050:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784405080.033060:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.033072:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151be00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784405080.033076:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.033086:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.033106:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abdb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.033113:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000501221df/0x24b3e2e6dcd7abdb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.033142:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405080.033144:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405080.033145:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784405080.033712:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405080.033721:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abe2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.033732:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1784405080.033736:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405080.033741:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.033753:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.033776:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.033784:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.033801:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784405080.033811:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784405080.033816:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.033823:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784405080.033826:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.033834:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abe2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.033846:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abe2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.033876:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ba453e7/0x24b3e2e6dcd7abe2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.033890:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405080.033898:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405080.033899:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784405080.036383:0:25040:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1784405080.036419:0:25040:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1784405080.036425:0:25040:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1784405080.036701:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23461:x1871083729050112:12345-0@lo:5:osp-pre-1-1.0 Request processed in 65504us (66325us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1784405080.036715:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784405080.036775:0:23461:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1784405080.036785:0:23461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d84000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23461:1871083729050112:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1784405080.036800:0:23461:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1784405080.036868:0:23461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d84000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23461:1871083729050240:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1784405080.036904:0:23461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405080.036926:0:23461:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd552712300 going to sleep for 11 seconds 00000100:00100000:1.0:1784405080.036997:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729050240 00000100:00100000:1.0:1784405080.037003:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729050240 00000100:00100000:1.0:1784405080.037051:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784405080.037061:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23461:x1871083729050240:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1784405080.037110:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23461:x1871083729050240:12345-0@lo:900:osp-pre-1-1.0 Request processed in 52us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405080.037117:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784405080.037146:0:23461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd443d84000 x1871083729050240/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784405096 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405080.037157:0:23461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d84000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23461:1871083729050240:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1784405080.037907:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405080.037916:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abe9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.038178:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1784405080.038184:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405080.038191:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.038222:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.038233:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.038241:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abe9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.038264:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784405080.038732:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784405080.038740:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abe9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.038750:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b800 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784405080.038755:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abe9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.038765:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abe9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.038783:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abe9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.038798:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004755198/0x24b3e2e6dcd7abe9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.038819:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.038821:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.038823:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784405080.042961:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405080.042983:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bee237f/0x24b3e2e6dcd7abf0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.043007:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1784405080.043013:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405080.043020:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bee237f/0x24b3e2e6dcd7abf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.043045:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bee237f/0x24b3e2e6dcd7abf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.043056:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bee237f/0x24b3e2e6dcd7abf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.043064:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bee237f/0x24b3e2e6dcd7abf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.043092:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784405080.043653:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784405080.043661:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bee237f/0x24b3e2e6dcd7abf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.043670:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784405080.043675:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bee237f/0x24b3e2e6dcd7abf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.043683:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bee237f/0x24b3e2e6dcd7abf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.043699:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bee237f/0x24b3e2e6dcd7abf0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.043707:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bee237f/0x24b3e2e6dcd7abf0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.043728:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.043730:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.043731:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784405080.044155:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405080.044162:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad90baf0/0x24b3e2e6dcd7abf7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044171:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1784405080.044174:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405080.044179:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad90baf0/0x24b3e2e6dcd7abf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044190:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad90baf0/0x24b3e2e6dcd7abf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044198:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad90baf0/0x24b3e2e6dcd7abf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044216:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad90baf0/0x24b3e2e6dcd7abf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044236:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784405080.044609:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405080.044616:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd7abfe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044624:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1784405080.044627:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405080.044632:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd7abfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044640:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd7abfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044647:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd7abfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044653:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd7abfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044669:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784405080.044679:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784405080.044684:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad90baf0/0x24b3e2e6dcd7abf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044697:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151aa00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784405080.044700:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad90baf0/0x24b3e2e6dcd7abf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044707:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad90baf0/0x24b3e2e6dcd7abf7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044718:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad90baf0/0x24b3e2e6dcd7abf7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044724:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad90baf0/0x24b3e2e6dcd7abf7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044738:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784405080.044740:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd7abfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044746:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151b000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784405080.044749:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd7abfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044755:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd7abfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044763:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd7abfe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044775:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e3c425a/0x24b3e2e6dcd7abfe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.044787:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405080.044789:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405080.044791:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784405080.045159:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405080.045166:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003c6d039/0x24b3e2e6dcd7ac05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.045173:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1784405080.045177:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405080.045181:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003c6d039/0x24b3e2e6dcd7ac05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.045190:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003c6d039/0x24b3e2e6dcd7ac05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.045197:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003c6d039/0x24b3e2e6dcd7ac05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.045204:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003c6d039/0x24b3e2e6dcd7ac05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.045330:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784405080.045666:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784405080.045677:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089f3293d/0x24b3e2e6dcd7ac0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.045685:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=697s v=(0 0) 00010000:00010000:3.0:1784405080.045688:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784405080.045692:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089f3293d/0x24b3e2e6dcd7ac0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.045700:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089f3293d/0x24b3e2e6dcd7ac0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.045708:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089f3293d/0x24b3e2e6dcd7ac0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405080.045715:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089f3293d/0x24b3e2e6dcd7ac0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.045740:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784405080.045746:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003c6d039/0x24b3e2e6dcd7ac05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.045754:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151ae00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784405080.045757:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003c6d039/0x24b3e2e6dcd7ac05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.045766:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003c6d039/0x24b3e2e6dcd7ac05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.045778:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003c6d039/0x24b3e2e6dcd7ac05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.045791:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003c6d039/0x24b3e2e6dcd7ac05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.045807:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784405080.045810:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089f3293d/0x24b3e2e6dcd7ac0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.045817:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784405080.045820:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089f3293d/0x24b3e2e6dcd7ac0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.045827:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089f3293d/0x24b3e2e6dcd7ac0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.045836:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089f3293d/0x24b3e2e6dcd7ac0c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.045843:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405080.045844:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405080.045846:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.050245:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784405080.050370:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784405080.050384:0:24642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089f3293d/0x24b3e2e6dcd7ac0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784405080.052950:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784405080.052964:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7ac13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.052981:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1784405080.052991:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784405080.052999:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7ac13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.053024:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7ac13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.053034:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7ac13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.053041:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7ac13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.056034:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784405080.056053:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7ac13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.056069:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784405080.056074:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7ac13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.056084:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7ac13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.056105:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7ac13 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.056117:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.056119:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.056121:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405080.056509:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784405080.056518:0:24642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011d8f9bd/0x24b3e2e6dcd7ac13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.057161:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784405080.057334:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784405080.057341:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096373a76/0x24b3e2e6dcd7ac1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.057354:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1784405080.057358:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784405080.057365:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096373a76/0x24b3e2e6dcd7ac1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.057379:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096373a76/0x24b3e2e6dcd7ac1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.057396:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096373a76/0x24b3e2e6dcd7ac1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.057404:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096373a76/0x24b3e2e6dcd7ac1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.057418:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784405080.057703:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784405080.057709:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096373a76/0x24b3e2e6dcd7ac1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.057717:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056e00 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784405080.057722:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096373a76/0x24b3e2e6dcd7ac1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.057731:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096373a76/0x24b3e2e6dcd7ac1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.057755:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096373a76/0x24b3e2e6dcd7ac1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.057762:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096373a76/0x24b3e2e6dcd7ac1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.057779:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.057780:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.057782:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784405080.057961:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784405080.057967:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7ac21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.057977:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1784405080.057980:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784405080.057984:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7ac21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.057993:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7ac21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.058000:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7ac21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.058018:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7ac21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.058045:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784405080.058388:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784405080.058393:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7ac21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.058402:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784405080.058405:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7ac21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.058414:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7ac21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.058426:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7ac21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.058434:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f940bff7/0x24b3e2e6dcd7ac21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.058469:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.058470:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.058472:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784405080.058594:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784405080.058600:0:24642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7ac28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.058607:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=697s v=(0 0) 00010000:00010000:2.0:1784405080.058611:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784405080.058614:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7ac28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.058624:0:24642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7ac28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.058631:0:24642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7ac28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.058638:0:24642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7ac28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405080.058657:0:24642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1784405080.058883:0:24642:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00010000:00010000:1.0:1784405080.059015:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784405080.059021:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7ac28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.059030:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056400 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:1.0:1784405080.059034:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7ac28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.059042:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7ac28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.059054:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7ac28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.059062:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bc21da6/0x24b3e2e6dcd7ac28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405080.059076:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.059078:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405080.059080:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784405080.059184:0:24642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22744:x1871083729049600:12345-0@lo:5:osp-pre-1-0.0 Request processed in 102822us (103400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405080.059195:0:24642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784405080.059249:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22744:1871083729049600:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1784405080.059269:0:22744:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1784405080.059329:0:22744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22744:1871083729050368:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1784405080.059364:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405080.059392:0:22744:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c83b000 going to sleep for 11 seconds 00000100:00100000:2.0:1784405080.059408:0:24642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729050368 00000100:00100000:2.0:1784405080.059414:0:24642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729050368 00000100:00100000:2.0:1784405080.059518:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784405080.059527:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22744:x1871083729050368:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1784405080.059571:0:24225:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:2.0:1784405080.062758:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22744:x1871083729050368:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3224us (3384us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1784405080.062772:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784405080.062831:0:22744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22744:1871083729050368:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1784405080.062847:0:22744:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:0.0:1784405080.067885:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405081.099456:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784405081.479762:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784405081.479785:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729050496:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784405081.479890:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405081.479936:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729050496 00000100:00100000:1.0:1784405081.479944:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729050496 00000100:00100000:1.0:1784405081.480013:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784405081.480024:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729050496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784405081.480064:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1784405081.480109:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729050496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405081.480117:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1784405081.480139:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784405081.480178:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729050496:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1784405081.527426:0:25396:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg242-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784405082.115283:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784405082.501051:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729050624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784405082.501128:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405082.501596:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729050624 00000100:00100000:2.0:1784405082.501605:0:23457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729050624 00000100:00100000:2.0:1784405082.501662:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784405082.501673:0:23457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729050624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784405082.501715:0:23457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784405082.501772:0:23457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729050624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405082.501780:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784405082.501831:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729050624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784405082.502007:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784405082.502021:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729050752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784405082.502062:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405082.502266:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729050752 00000100:00100000:2.0:1784405082.502272:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729050752 00000100:00100000:2.0:1784405082.502380:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784405082.502388:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729050752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784405082.502406:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1784405082.502448:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729050752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405082.502454:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784405082.504090:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784405082.504112:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729050880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784405082.504183:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405082.506827:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729050880 00000100:00100000:2.0:1784405082.506842:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729050880 00000100:00100000:2.0:1784405082.506931:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784405082.506942:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729050880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784405082.506983:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1784405082.507067:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729050880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (2884us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405082.507074:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784405082.507126:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729050880:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1784405082.509372:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784405082.509448:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729050752:0@lo:13:osp-pre-0-0.0 00000020:00000004:0.0:1784405082.564115:0:25448:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784405082.564599:0:25448:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784405083.139323:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784405083.409471:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1784405083.421771:0:25498:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784405083.422453:0:25498:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784405083.797232:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405083.797390:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707972480 00000100:00100000:0.0:1784405083.797409:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707972480 00000100:00100000:0.0:1784405083.797459:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 115 00000100:00100000:0.0:1784405083.797468:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54a7b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2400:x1871083707972480:12345-192.168.202.42@tcp:250:mount.lustre.0 00010000:00080000:0.0:1784405083.797505:0:22710:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3@192.168.202.42@tcp t0 exp 0000000000000000 cur 701 last 0 00000020:00000080:0.0:1784405083.797550:0:22710:0:(genops.c:1385:class_connect()) connect: client fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3, cookie 0x24b3e2e6dcd7ac2f 00000100:00080000:0.0:1784405083.797732:0:22710:0:(import.c:65:import_set_state_nolock()) ffff9dd573aad800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784405083.797823:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54a7b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+5:2400:x1871083707972480:12345-192.168.202.42@tcp:250:mount.lustre.0 Request processed in 353us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405083.797831:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 115 00000100:00100000:3.0:1784405083.823960:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405083.824903:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707972608 00000100:00100000:0.0:1784405083.824915:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707972608 00000100:00100000:0.0:1784405083.824970:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 116 00000100:00100000:0.0:1784405083.824980:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54a7b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+5:18072:x1871083707972608:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784405083.825000:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405083.825020:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd5821da400/0x24b3e2e6dcd7ac36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7746 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405083.825049:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd5821da400/0x24b3e2e6dcd7ac36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7746 expref: 6 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405083.825059:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd5821da400/0x24b3e2e6dcd7ac36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7746 expref: 6 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405083.825068:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd5821da400, rc 0) 00000100:00100000:0.0:1784405083.825139:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54a7b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+6:18072:x1871083707972608:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 160us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405083.825146:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 116 00000100:00100000:3.0:1784405083.831830:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405083.832205:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707972736 00000100:00100000:2.0:1784405083.832216:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707972736 00000100:00100000:2.0:1784405083.832269:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 117 00000100:00100000:2.0:1784405083.832290:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+6:18072:x1871083707972736:12345-192.168.202.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784405083.832562:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+6:18072:x1871083707972736:12345-192.168.202.42@tcp:501:mount.lustre.0 Request processed in 283us (745us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784405083.832572:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 117 00000100:00100000:2.0:1784405083.848254:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405083.848343:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707972864 00000100:00100000:1.0:1784405083.848354:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707972864 00000100:00100000:1.0:1784405083.848427:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 118 00000100:00100000:1.0:1784405083.848438:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+6:18072:x1871083707972864:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784405083.848455:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784405083.848476:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd57331ce00/0x24b3e2e6dcd7ac3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed774d expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405083.848530:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd57331ce00/0x24b3e2e6dcd7ac3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed774d expref: 7 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405083.848542:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd57331ce00/0x24b3e2e6dcd7ac3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed774d expref: 7 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405083.848552:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331ce00, rc 0) 00000100:00100000:1.0:1784405083.848611:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+7:18072:x1871083707972864:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 174us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405083.848618:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 118 00000100:00100000:3.0:1784405083.853086:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405083.853231:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707972992 00000100:00100000:2.0:1784405083.853241:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707972992 00000100:00100000:2.0:1784405083.853328:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 119 00000100:00100000:2.0:1784405083.853338:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+7:18072:x1871083707972992:12345-192.168.202.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784405083.853495:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+8:18072:x1871083707972992:12345-192.168.202.42@tcp:501:mount.lustre.0 Request processed in 157us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405083.853504:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 119 00000100:00100000:3.0:1784405083.862434:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405083.862671:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707973120 00000100:00100000:1.0:1784405083.862683:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707973120 00000100:00100000:1.0:1784405083.862749:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 120 00000100:00100000:1.0:1784405083.862760:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+8:18072:x1871083707973120:12345-192.168.202.42@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784405083.862954:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+8:18072:x1871083707973120:12345-192.168.202.42@tcp:503:mount.lustre.0 Request processed in 194us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405083.862963:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 120 00000100:00100000:3.0:1784405083.872068:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405083.876488:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707973248 00000100:00100000:0.0:1784405083.876510:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707973248 00000100:00100000:0.0:1784405083.876600:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 121 00000100:00100000:0.0:1784405083.876611:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+8:18091:x1871083707973248:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784405083.876806:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+8:18091:x1871083707973248:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 196us (4747us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405083.876814:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 121 00000100:00100000:3.0:1784405083.892017:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405083.892156:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707973376 00000100:00100000:2.0:1784405083.892170:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707973376 00000100:00100000:2.0:1784405083.892251:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 122 00000100:00100000:2.0:1784405083.892273:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+8:18091:x1871083707973376:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784405083.892497:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+8:18091:x1871083707973376:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 226us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405083.892506:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 122 00000100:00100000:3.0:1784405083.904089:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405083.904497:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707973504 00000100:00100000:1.0:1784405083.904509:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707973504 00000100:00100000:1.0:1784405083.904585:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 123 00000100:00100000:1.0:1784405083.904596:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+8:18091:x1871083707973504:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784405083.904767:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+8:18091:x1871083707973504:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 171us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405083.904776:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 123 00000100:00100000:3.0:1784405083.912576:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405083.912902:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707973632 00000100:00100000:0.0:1784405083.912914:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707973632 00000100:00100000:0.0:1784405083.912965:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 124 00000100:00100000:0.0:1784405083.912986:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+8:18072:x1871083707973632:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784405083.913023:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405083.913041:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd5821da200/0x24b3e2e6dcd7ac44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed777e expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405083.913070:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd5821da200/0x24b3e2e6dcd7ac44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed777e expref: 9 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405083.913082:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd5821da200/0x24b3e2e6dcd7ac44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed777e expref: 9 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405083.913092:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd5821da200, rc 0) 00000100:00100000:0.0:1784405083.913155:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+9:18072:x1871083707973632:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 171us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405083.913162:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 124 00000100:00100000:3.0:1784405083.918229:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405083.918506:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707973760 00000100:00100000:2.0:1784405083.918517:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707973760 00000100:00100000:2.0:1784405083.918576:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 125 00000100:00100000:2.0:1784405083.918586:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+9:18072:x1871083707973760:12345-192.168.202.42@tcp:256:mount.lustre.0 20000000:01000000:2.0:1784405083.918611:0:22710:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784405083.918636:0:22710:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784405083.918640:0:22710:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784405083.918643:0:22710:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784405083.918645:0:22710:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1784405083.918648:0:22710:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1784405083.923434:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+9:18072:x1871083707973760:12345-192.168.202.42@tcp:256:mount.lustre.0 Request processed in 4831us (5198us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405083.923453:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 125 00000100:00100000:3.0:1784405083.932743:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405083.932935:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707973888 00000100:00100000:1.0:1784405083.932961:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707973888 00000100:00100000:1.0:1784405083.933036:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 126 00000100:00100000:1.0:1784405083.933049:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+9:18072:x1871083707973888:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784405083.933066:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784405083.933085:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd57331dc00/0x24b3e2e6dcd7ac4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7785 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405083.933114:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd57331dc00/0x24b3e2e6dcd7ac4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7785 expref: 10 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405083.933126:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd57331dc00/0x24b3e2e6dcd7ac4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7785 expref: 10 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405083.933135:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331dc00, rc 0) 00000100:00100000:1.0:1784405083.933202:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+10:18072:x1871083707973888:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 156us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405083.933209:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 126 00000100:00100000:3.0:1784405083.946102:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405083.946188:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707974016 00000100:00100000:2.0:1784405083.946206:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707974016 00000100:00100000:2.0:1784405083.946259:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 127 00000100:00100000:2.0:1784405083.946267:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44356e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+10:18072:x1871083707974016:12345-192.168.202.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784405083.946439:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44356e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+10:18072:x1871083707974016:12345-192.168.202.42@tcp:501:mount.lustre.0 Request processed in 171us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405083.946446:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 127 00000100:00100000:3.0:1784405083.951142:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405083.951233:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707974144 00000100:00100000:0.0:1784405083.951244:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707974144 00000100:00100000:0.0:1784405083.951318:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 128 00000100:00100000:0.0:1784405083.951328:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+10:18072:x1871083707974144:12345-192.168.202.42@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784405083.951486:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+10:18072:x1871083707974144:12345-192.168.202.42@tcp:503:mount.lustre.0 Request processed in 158us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405083.951500:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 128 00000100:00100000:3.0:1784405083.956010:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405083.956210:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707974272 00000100:00100000:1.0:1784405083.956219:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707974272 00000100:00100000:1.0:1784405083.956271:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 129 00000100:00100000:1.0:1784405083.956293:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+10:18096:x1871083707974272:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784405083.956446:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+10:18096:x1871083707974272:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 166us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405083.956452:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 129 00000100:00100000:3.0:1784405083.967023:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405083.968389:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707974400 00000100:00100000:2.0:1784405083.968400:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707974400 00000100:00100000:2.0:1784405083.968473:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 130 00000100:00100000:2.0:1784405083.968483:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+10:18096:x1871083707974400:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784405083.968660:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+10:18096:x1871083707974400:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 177us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405083.968668:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 130 00000100:00100000:3.0:1784405083.981335:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405083.981428:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405083.981751:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707974528 00000100:00100000:0.0:1784405083.981763:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707974528 00000100:00100000:0.0:1784405083.981812:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707974784 00000100:00100000:0.0:1784405083.981815:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707974784 00000100:00100000:0.0:1784405083.981842:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:0.0:1784405083.981879:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1871083707974528:12345-192.168.202.42@tcp:38:mount.lustre.0 00010000:00080000:0.0:1784405083.981912:0:24942:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 4bfe57d2-0189-4fcc-8706-d3fc83c1de0c@192.168.202.42@tcp t0 exp 0000000000000000 cur 701 last 0 00000100:00100000:2.0:1784405083.981981:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:2.0:1784405083.981988:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1871083707974784:12345-192.168.202.42@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784405083.982004:0:22718:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 4bfe57d2-0189-4fcc-8706-d3fc83c1de0c@192.168.202.42@tcp t0 exp 0000000000000000 cur 701 last 0 00000020:00000080:0.0:1784405083.982019:0:24942:0:(genops.c:1385:class_connect()) connect: client 4bfe57d2-0189-4fcc-8706-d3fc83c1de0c, cookie 0x24b3e2e6dcd7ac52 00000020:00000080:2.0:1784405083.982035:0:22718:0:(genops.c:1385:class_connect()) connect: client 4bfe57d2-0189-4fcc-8706-d3fc83c1de0c, cookie 0x24b3e2e6dcd7ac59 00000004:00100000:0.0:1784405083.982042:0:24942:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000004:00100000:2.0:1784405083.982046:0:22718:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784405083.982227:0:22718:0:(import.c:65:import_set_state_nolock()) ffff9dd44224e800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1784405083.982420:0:24942:0:(import.c:65:import_set_state_nolock()) ffff9dd55f141800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784405083.982478:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:2400:x1871083707974528:12345-192.168.202.42@tcp:38:mount.lustre.0 Request processed in 627us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405083.982487:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:2.0:1784405083.982999:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:2400:x1871083707974784:12345-192.168.202.42@tcp:38:mount.lustre.0 Request processed in 1008us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405083.983007:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:3.0:1784405084.007156:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405084.007206:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405084.007240:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405084.010106:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707975040 00000100:00100000:1.0:1784405084.010122:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707975040 00000100:00100000:1.0:1784405084.010216:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707974656 00000100:00100000:1.0:1784405084.010220:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707974656 00000100:00100000:1.0:1784405084.010250:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707974912 00000100:00100000:1.0:1784405084.010253:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707974912 00000100:00100000:1.0:1784405084.010289:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:1.0:1784405084.010301:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+7:18072:x1871083707975040:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784405084.010340:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1784405084.010428:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+7:18072:x1871083707975040:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 128us (3282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405084.010435:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:1.0:1784405084.010452:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:1.0:1784405084.010459:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:0:x1871083707974656:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784405084.010469:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1784405084.010495:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:0:x1871083707974656:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 36us (3288us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405084.010501:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:1.0:1784405084.010514:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:1.0:1784405084.010520:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:0:x1871083707974912:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784405084.010538:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:3.0:1784405084.013899:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784405084.013911:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784405084.015132:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:0:x1871083707974912:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 4601us (7880us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405084.015146:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:3.0:1784405084.032051:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405084.032201:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707975168 00000100:00100000:0.0:1784405084.032212:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707975168 00000100:00100000:0.0:1784405084.032275:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:0.0:1784405084.032299:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:18072:x1871083707975168:12345-192.168.202.42@tcp:40:mount.lustre.0 00000100:00100000:0.0:1784405084.032403:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:18072:x1871083707975168:12345-192.168.202.42@tcp:40:mount.lustre.0 Request processed in 107us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405084.032410:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:0.0:1784405084.038090:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405084.038126:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707975296 00000100:00100000:2.0:1784405084.038136:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707975296 00000100:00100000:2.0:1784405084.038199:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:2.0:1784405084.038223:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2400:x1871083707975296:12345-192.168.202.42@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784405084.038421:0:24222:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 4bfe57d2-0189-4fcc-8706-d3fc83c1de0c@192.168.202.42@tcp t0 exp 0000000000000000 cur 701 last 0 00000020:00000080:2.0:1784405084.038455:0:24222:0:(genops.c:1385:class_connect()) connect: client 4bfe57d2-0189-4fcc-8706-d3fc83c1de0c, cookie 0x24b3e2e6dcd7ac60 00002000:00100000:2.0:1784405084.038469:0:24222:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4bfe57d2-0189-4fcc-8706-d3fc83c1de0c/ffff9dd44224b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784405084.038489:0:24222:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784405084.038664:0:24222:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784405084.038696:0:24222:0:(import.c:65:import_set_state_nolock()) ffff9dd44224d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784405084.038770:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:2400:x1871083707975296:12345-192.168.202.42@tcp:8:mount.lustre.0 Request processed in 547us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405084.038778:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:1.0:1784405084.051762:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405084.051810:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405084.051899:0:24642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707975424 00000100:00100000:3.0:1784405084.051910:0:24642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707975424 00000100:00100000:3.0:1784405084.051956:0:24642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:3.0:1784405084.051965:0:24642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2400:x1871083707975424:12345-192.168.202.42@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784405084.052017:0:24642:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 4bfe57d2-0189-4fcc-8706-d3fc83c1de0c@192.168.202.42@tcp t0 exp 0000000000000000 cur 701 last 0 00000020:00000080:3.0:1784405084.052047:0:24642:0:(genops.c:1385:class_connect()) connect: client 4bfe57d2-0189-4fcc-8706-d3fc83c1de0c, cookie 0x24b3e2e6dcd7ac67 00002000:00100000:3.0:1784405084.052059:0:24642:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4bfe57d2-0189-4fcc-8706-d3fc83c1de0c/ffff9dd4435a4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784405084.052078:0:24642:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784405084.052504:0:24642:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784405084.052543:0:24642:0:(import.c:65:import_set_state_nolock()) ffff9dd4435a7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784405084.052627:0:24642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:2400:x1871083707975424:12345-192.168.202.42@tcp:8:mount.lustre.0 Request processed in 660us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405084.052651:0:24642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:2.0:1784405084.052983:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707975552 00000100:00100000:2.0:1784405084.052990:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707975552 00000100:00100000:2.0:1784405084.053041:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:2.0:1784405084.053050:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:18072:x1871083707975552:12345-192.168.202.42@tcp:900:mount.lustre.0 00000100:00100000:2.0:1784405084.053090:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:18072:x1871083707975552:12345-192.168.202.42@tcp:900:mount.lustre.0 Request processed in 42us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405084.053097:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:3.0:1784405084.069627:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405084.069742:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707975680 00000100:00100000:2.0:1784405084.069753:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707975680 00000100:00100000:2.0:1784405084.069888:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:2.0:1784405084.069901:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:18072:x1871083707975680:12345-192.168.202.42@tcp:33:mount.lustre.0 00000004:00080000:1.0:1784405084.072878:0:22720:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2874us 00000004:00200000:0.0:1784405084.115312:0:22720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1784405084.115488:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:18072:x1871083707975680:12345-192.168.202.42@tcp:33:mount.lustre.0 Request processed in 45584us (45863us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405084.115512:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 0 00010000:00010000:1.0:1784405084.163088:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784405084.352985:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405084.353425:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707975808 00000100:00100000:3.0:1784405084.353438:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707975808 00000100:00100000:3.0:1784405084.353543:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:3.0:1784405084.353555:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:18119:x1871083707975808:12345-192.168.202.42@tcp:101:mkdir.0 00010000:00010000:3.0:1784405084.353581:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784405084.353611:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7ac6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed77b6 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405084.353704:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd7ac75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405084.354807:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd7ac75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405084.354827:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd7ac75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784405084.355141:0:22719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784405084.355146:0:22719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784405084.355193:0:22719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd7ac75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405084.355230:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7ac6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed77b6 expref: 8 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405084.355251:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd7ac75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed77b6 expref: 7 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405084.355301:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd544e47700) 00010000:00010000:3.0:1784405084.355305:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784405084.355309:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a400, rc 0) 00000100:00100000:3.0:1784405084.355405:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+7:18119:x1871083707975808:12345-192.168.202.42@tcp:101:mkdir.0 Request processed in 1850us (2432us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405084.355413:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:3.0:1784405085.059144:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729051008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784405085.059202:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729051136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784405085.060030:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729051392:0@lo:400:kworker.0 00000100:00100000:1.0:1784405085.060111:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3648:1871083729051264:0@lo:400:kworker.0 00000100:00100000:2.0:1784405085.065424:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405085.065511:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729051648:0@lo:400:kworker.0 00000100:00100000:2.0:1784405085.065563:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405085.065586:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729052160:0@lo:400:kworker.0 00000100:00100000:2.0:1784405085.065608:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405085.065625:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083729052672:0@lo:400:kworker.0 00000100:00100000:2.0:1784405085.065652:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405085.065680:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784405085.065687:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729051520:0@lo:400:kworker.0 00000100:00100000:2.0:1784405085.066717:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405085.066770:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729052032:0@lo:400:kworker.0 00000100:00100000:2.0:1784405085.066795:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405085.066814:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083729052544:0@lo:400:kworker.0 00000100:00100000:2.0:1784405085.067120:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405085.067254:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729051136 00000100:00100000:2.0:1784405085.067265:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729051136 00000100:00100000:2.0:1784405085.067351:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784405085.067363:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1871083729051136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784405085.067394:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784405085.067448:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1871083729051136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (2030us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405085.067458:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784405085.067486:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729051648 00000100:00100000:2.0:1784405085.067490:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729051648 00000100:00100000:2.0:1784405085.067510:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729052160 00000100:00100000:2.0:1784405085.067512:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729052160 00000100:00100000:2.0:1784405085.067528:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729051520 00000100:00100000:2.0:1784405085.067531:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729051520 00000100:00100000:2.0:1784405085.067544:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729052032 00000100:00100000:2.0:1784405085.067564:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729052032 00000100:00100000:2.0:1784405085.067654:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784405085.067661:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1871083729051648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405085.067900:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1871083729051648:12345-0@lo:400:kworker.0 Request processed in 239us (2335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405085.067907:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784405085.067919:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784405085.067926:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729052160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405085.067952:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729052160:12345-0@lo:400:kworker.0 Request processed in 28us (2343us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405085.067958:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784405085.067967:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784405085.067972:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729051520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405085.067995:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729051520:12345-0@lo:400:kworker.0 Request processed in 23us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405085.068000:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784405085.068008:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784405085.068013:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729052032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405085.068036:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729052032:12345-0@lo:400:kworker.0 Request processed in 22us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405085.068041:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1784405085.068060:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784405085.068064:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784405085.068102:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729051520:0@lo:400:kworker.0 00000100:00100000:2.0:1784405085.068113:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729052032:0@lo:400:kworker.0 00000100:00100000:2.0:1784405085.068135:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729051648:0@lo:400:kworker.0 00000100:00100000:2.0:1784405085.068145:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729052160:0@lo:400:kworker.0 00000100:00100000:2.0:1784405085.068161:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729051136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784405085.068427:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729052672 00000100:00100000:2.0:1784405085.068432:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729052672 00000100:00100000:2.0:1784405085.068461:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729052544 00000100:00100000:2.0:1784405085.068463:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729052544 00000100:00100000:2.0:1784405085.068480:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784405085.068486:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083729052672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405085.068522:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1871083729052672:12345-0@lo:400:kworker.0 Request processed in 36us (2870us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405085.068528:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784405085.068540:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784405085.068545:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083729052544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405085.068567:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083729052544:12345-0@lo:400:kworker.0 Request processed in 22us (1729us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405085.068571:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1784405085.068588:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784405085.068591:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784405085.068612:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd565e73b80 x1871083729052544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784405085.068623:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083729052544:0@lo:400:kworker.0 00000100:00100000:2.0:1784405085.068633:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1871083729052672:0@lo:400:kworker.0 00000100:00100000:3.0:1784405085.072152:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405085.072477:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729051008 00000100:00100000:2.0:1784405085.072505:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729051008 00000100:00100000:2.0:1784405085.072579:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784405085.072589:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729051008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784405085.072619:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784405085.072685:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729051008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405085.072694:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784405085.075207:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729051008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784405085.076711:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405085.076775:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729051904:0@lo:400:kworker.0 00000100:00100000:0.0:1784405085.076808:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405085.076836:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729051392 00000100:00100000:0.0:1784405085.076843:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729051392 00000100:00100000:0.0:1784405085.076901:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729051904 00000100:00100000:0.0:1784405085.076904:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729051904 00000100:00100000:0.0:1784405085.076921:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784405085.076930:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729051392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405085.076983:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729051392:12345-0@lo:400:kworker.0 Request processed in 53us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405085.076990:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784405085.077008:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784405085.077015:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729051904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405085.077043:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729051904:12345-0@lo:400:kworker.0 Request processed in 30us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405085.077049:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784405085.077082:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729051904:0@lo:400:kworker.0 00000100:00100000:0.0:1784405085.077090:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083729052416:0@lo:400:kworker.0 00000100:00100000:0.0:1784405085.077115:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405085.077160:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729051392:0@lo:400:kworker.0 00000100:00100000:3.0:1784405085.080035:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729052416 00000100:00100000:3.0:1784405085.080049:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729052416 00000100:00100000:3.0:1784405085.080142:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784405085.080153:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083729052416:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784405085.080213:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784405085.080247:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1871083729052416:12345-0@lo:400:kworker.0 Request processed in 96us (3131us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405085.080254:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784405085.080266:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1871083729052416:0@lo:400:kworker.0 00000100:00100000:1.0:1784405085.082895:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405085.082958:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083729051776:0@lo:400:kworker.0 00000100:00100000:1.0:1784405085.082994:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405085.083024:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083729052288:0@lo:400:kworker.0 00000100:00100000:1.0:1784405085.083048:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405085.083084:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd565e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083729052800:0@lo:400:kworker.0 00000100:00100000:1.0:1784405085.083104:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405085.083154:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729051776 00000100:00100000:1.0:1784405085.083162:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729051776 00000100:00100000:1.0:1784405085.083209:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729052288 00000100:00100000:1.0:1784405085.083213:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729052288 00000100:00100000:1.0:1784405085.083222:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729052800 00000100:00100000:1.0:1784405085.083225:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729052800 00000100:00100000:1.0:1784405085.083249:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784405085.083256:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083729051776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405085.083316:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1871083729051776:12345-0@lo:400:kworker.0 Request processed in 60us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405085.083323:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784405085.083339:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784405085.083345:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083729052288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405085.083368:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1871083729052288:12345-0@lo:400:kworker.0 Request processed in 24us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405085.083375:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784405085.083384:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784405085.083390:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083729052800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405085.083430:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1871083729052800:12345-0@lo:400:kworker.0 Request processed in 40us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405085.083437:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1784405085.083454:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784405085.083482:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1871083729051776:0@lo:400:kworker.0 00000100:00100000:1.0:1784405085.083492:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1871083729052288:0@lo:400:kworker.0 00010000:00080000:1.0:1784405085.083504:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd565e72680 x1871083729052800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405085.083514:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd565e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1871083729052800:0@lo:400:kworker.0 00000100:00100000:0.0:1784405085.083668:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729051264 00000100:00100000:0.0:1784405085.083678:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729051264 00000100:00100000:0.0:1784405085.083727:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784405085.083734:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:3648:x1871083729051264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405085.083772:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:3648:x1871083729051264:12345-0@lo:400:kworker.0 Request processed in 39us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405085.083778:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784405085.083815:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3648:1871083729051264:0@lo:400:kworker.0 00010000:00010000:1.0:1784405085.187091:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784405086.091043:0:25040:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4bfe57d2-0189-4fcc-8706-d3fc83c1de0c 00000001:00080000:1.0:1784405086.091059:0:25040:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:0.0:1784405086.211314:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784405086.595096:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784405086.595122:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd577ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729052928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784405086.595145:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405086.595180:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707975936 00000100:00100000:3.0:1784405086.595182:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405086.595186:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707975936 00000100:00080000:3.0:1784405086.595231:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784405086.595243:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:1.0:1784405086.595252:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+7:18172:x1871083707975936:12345-192.168.202.42@tcp:41:lfs.0 00000004:00000024:1.0:1784405086.595298:0:22718:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1784405086.595383:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+7:18172:x1871083707975936:12345-192.168.202.42@tcp:41:lfs.0 Request processed in 131us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405086.595391:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:2.0:1784405086.595553:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729052928 00000100:00100000:2.0:1784405086.595558:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729052928 00000100:00100000:2.0:1784405086.595606:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784405086.595613:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729052928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784405086.595634:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1784405086.595675:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729052928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405086.595682:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784405086.595724:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd577ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729052928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784405086.598953:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405086.599058:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707976064 00000100:00100000:3.0:1784405086.599069:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707976064 00000100:00100000:3.0:1784405086.599154:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:3.0:1784405086.599190:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:18172:x1871083707976064:12345-192.168.202.42@tcp:41:lfs.0 00000004:00000024:3.0:1784405086.599233:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784405086.599338:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:18172:x1871083707976064:12345-192.168.202.42@tcp:41:lfs.0 Request processed in 151us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405086.599346:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00080000:1.0:1784405086.599764:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784405086.608297:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405086.608466:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707976192 00000100:00100000:2.0:1784405086.608477:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707976192 00000100:00100000:2.0:1784405086.608552:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:2.0:1784405086.608564:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:18172:x1871083707976192:12345-192.168.202.42@tcp:13:lfs.0 00002000:00000024:2.0:1784405086.608594:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1784405086.608693:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:18172:x1871083707976192:12345-192.168.202.42@tcp:13:lfs.0 Request processed in 131us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405086.608700:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00080000:1.0:1784405086.611688:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784405086.617394:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405086.617554:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707976320 00000100:00100000:2.0:1784405086.617564:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707976320 00000100:00100000:2.0:1784405086.617642:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:2.0:1784405086.617654:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:18172:x1871083707976320:12345-192.168.202.42@tcp:13:lfs.0 00002000:00000024:2.0:1784405086.617689:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784405086.617790:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:18172:x1871083707976320:12345-192.168.202.42@tcp:13:lfs.0 Request processed in 138us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405086.617798:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00080000:1.0:1784405086.617874:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784405086.900294:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405086.900688:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707976448 00000100:00100000:1.0:1784405086.900715:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707976448 00000100:00100000:1.0:1784405086.900829:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 132 00000100:00100000:1.0:1784405086.900842:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+10:18205:x1871083707976448:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784405086.900916:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784405086.900935:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd57331c600/0x24b3e2e6dcd7ac7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed77bd expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405086.900965:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd57331c600/0x24b3e2e6dcd7ac7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed77bd expref: 11 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405086.900977:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd57331c600/0x24b3e2e6dcd7ac7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed77bd expref: 11 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405086.900986:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331c600, rc 0) 00000100:00100000:1.0:1784405086.901073:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+11:18205:x1871083707976448:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 234us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405086.901079:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 132 00000100:00100000:0.0:1784405086.905660:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405086.906131:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707976576 00000100:00100000:1.0:1784405086.906141:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707976576 00000100:00100000:1.0:1784405086.906811:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 133 00000100:00100000:1.0:1784405086.906822:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+11:18205:x1871083707976576:12345-192.168.202.42@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784405086.907562:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+11:18205:x1871083707976576:12345-192.168.202.42@tcp:501:mount.lustre.0 Request processed in 737us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405086.907572:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 133 00000100:00100000:2.0:1784405086.910330:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405086.910481:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707976704 00000100:00100000:1.0:1784405086.910491:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707976704 00000100:00100000:1.0:1784405086.910550:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 134 00000100:00100000:1.0:1784405086.910562:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+11:18205:x1871083707976704:12345-192.168.202.42@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784405086.910723:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+11:18205:x1871083707976704:12345-192.168.202.42@tcp:503:mount.lustre.0 Request processed in 162us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405086.910731:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 134 00000100:00100000:2.0:1784405086.923554:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405086.927788:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707976832 00000100:00100000:0.0:1784405086.927803:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707976832 00000100:00100000:0.0:1784405086.927916:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 135 00000100:00100000:0.0:1784405086.927926:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+11:18211:x1871083707976832:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784405086.928128:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+11:18211:x1871083707976832:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 202us (4584us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405086.928136:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 135 00000100:00100000:0.0:1784405086.974081:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405086.984385:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707976960 00000100:00100000:2.0:1784405086.984403:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707976960 00000100:00100000:2.0:1784405086.984490:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 136 00000100:00100000:2.0:1784405086.984503:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+11:18211:x1871083707976960:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784405086.984769:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+11:18211:x1871083707976960:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 267us (10699us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405086.985159:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 136 00000100:00100000:2.0:1784405086.991319:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405086.993338:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707977088 00000100:00100000:1.0:1784405086.993355:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707977088 00000100:00100000:1.0:1784405086.993428:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 137 00000100:00100000:1.0:1784405086.993439:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+11:18211:x1871083707977088:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784405086.993604:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+11:18211:x1871083707977088:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 166us (2298us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405086.993613:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 137 00000100:00100000:0.0:1784405087.002171:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405087.002442:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707977216 00000100:00100000:2.0:1784405087.002453:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707977216 00000100:00100000:2.0:1784405087.002522:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 138 00000100:00100000:2.0:1784405087.002534:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+11:18205:x1871083707977216:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784405087.002553:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784405087.002577:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd442057400/0x24b3e2e6dcd7ac83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed77ee expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405087.002610:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd442057400/0x24b3e2e6dcd7ac83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed77ee expref: 12 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405087.002637:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd442057400/0x24b3e2e6dcd7ac83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed77ee expref: 12 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405087.002647:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442057400, rc 0) 00000100:00100000:2.0:1784405087.002716:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+12:18205:x1871083707977216:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 184us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405087.002723:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 138 00000100:00100000:3.0:1784405087.011387:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405087.011573:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707977344 00000100:00100000:0.0:1784405087.011585:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707977344 00000100:00100000:0.0:1784405087.011646:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 139 00000100:00100000:0.0:1784405087.011657:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+12:18205:x1871083707977344:12345-192.168.202.42@tcp:256:mount.lustre.0 20000000:01000000:0.0:1784405087.011684:0:22712:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784405087.011709:0:22712:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784405087.011718:0:22712:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784405087.011721:0:22712:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784405087.011724:0:22712:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1784405087.011727:0:22712:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1784405087.015446:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+12:18205:x1871083707977344:12345-192.168.202.42@tcp:256:mount.lustre.0 Request processed in 3779us (4058us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405087.015462:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 139 00000100:00100000:1.0:1784405087.024626:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405087.024729:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707977472 00000100:00100000:0.0:1784405087.024799:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707977472 00000100:00100000:0.0:1784405087.025425:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 140 00000100:00100000:0.0:1784405087.025439:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+12:18205:x1871083707977472:12345-192.168.202.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784405087.025457:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405087.025475:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ac8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed77f5 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405087.025506:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ac8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed77f5 expref: 13 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405087.025518:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ac8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed77f5 expref: 13 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405087.025527:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd5821db600, rc 0) 00000100:00100000:0.0:1784405087.025597:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:18205:x1871083707977472:12345-192.168.202.42@tcp:101:mount.lustre.0 Request processed in 161us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405087.025604:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 140 00000100:00100000:3.0:1784405087.029595:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405087.033210:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707977600 00000100:00100000:2.0:1784405087.033227:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707977600 00000100:00100000:2.0:1784405087.033306:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 141 00000100:00100000:2.0:1784405087.033316:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:18205:x1871083707977600:12345-192.168.202.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784405087.033522:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:18205:x1871083707977600:12345-192.168.202.42@tcp:501:mount.lustre.0 Request processed in 207us (3936us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405087.033531:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 141 00000100:00100000:1.0:1784405087.042633:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405087.044495:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707977728 00000100:00100000:2.0:1784405087.044509:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707977728 00000100:00100000:2.0:1784405087.044794:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 142 00000100:00100000:2.0:1784405087.044808:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:18205:x1871083707977728:12345-192.168.202.42@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784405087.045223:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:18205:x1871083707977728:12345-192.168.202.42@tcp:503:mount.lustre.0 Request processed in 417us (2601us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405087.045233:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 142 00000100:00100000:3.0:1784405087.068234:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405087.068575:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707977856 00000100:00100000:1.0:1784405087.068586:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707977856 00000100:00100000:1.0:1784405087.068658:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 143 00000100:00100000:1.0:1784405087.068669:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:18215:x1871083707977856:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784405087.068842:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:18215:x1871083707977856:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 174us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405087.068888:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 143 00000100:00100000:3.0:1784405087.081120:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405087.081326:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707977984 00000100:00100000:2.0:1784405087.081336:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707977984 00000100:00100000:2.0:1784405087.081389:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 144 00000100:00100000:2.0:1784405087.081399:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:18215:x1871083707977984:12345-192.168.202.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784405087.081575:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:18215:x1871083707977984:12345-192.168.202.42@tcp:502:llog_process_th.0 Request processed in 176us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405087.081583:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 144 00000100:00100000:2.0:1784405087.099166:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405087.099209:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405087.099239:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707978880 00000100:00100000:2.0:1784405087.099247:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405087.099250:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707978880 00000100:00100000:1.0:1784405087.099311:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707978112 00000100:00100000:1.0:1784405087.099315:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707978112 00000100:00100000:1.0:1784405087.099339:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00100000:2.0:1784405087.099347:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405087.099352:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:2403:x1871083707978880:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784405087.099453:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:2403:x1871083707978880:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 105us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405087.099461:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00100000:1.0:1784405087.099477:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707978368 00000100:00100000:1.0:1784405087.099480:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707978368 00000100:00100000:1.0:1784405087.099492:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:1.0:1784405087.099496:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1871083707978112:12345-192.168.202.42@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784405087.099518:0:22718:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 2007b688-b060-4b6f-9f62-4b541c93b597@192.168.202.42@tcp t0 exp 0000000000000000 cur 704 last 0 00000020:00000080:1.0:1784405087.099552:0:22718:0:(genops.c:1385:class_connect()) connect: client 2007b688-b060-4b6f-9f62-4b541c93b597, cookie 0x24b3e2e6dcd7ac91 00000004:00100000:1.0:1784405087.099578:0:22718:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784405087.099741:0:22718:0:(import.c:65:import_set_state_nolock()) ffff9dd442695800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784405087.099787:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2007b688-b060-4b6f-9f62-4b541c93b597+6:2400:x1871083707978112:12345-192.168.202.42@tcp:38:mount.lustre.0 Request processed in 288us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405087.099794:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:1.0:1784405087.099809:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:1.0:1784405087.099814:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1871083707978368:12345-192.168.202.42@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784405087.099828:0:22718:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 2007b688-b060-4b6f-9f62-4b541c93b597@192.168.202.42@tcp t0 exp 0000000000000000 cur 704 last 0 00000020:00000080:1.0:1784405087.099875:0:22718:0:(genops.c:1385:class_connect()) connect: client 2007b688-b060-4b6f-9f62-4b541c93b597, cookie 0x24b3e2e6dcd7ac98 00000004:00100000:1.0:1784405087.099888:0:22718:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1784405087.100296:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707979136 00000100:00100000:3.0:1784405087.100303:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707979136 00000100:00100000:3.0:1784405087.100344:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:3.0:1784405087.100352:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:2403:x1871083707979136:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784405087.100521:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:2403:x1871083707979136:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 169us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405087.100529:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00080000:1.0:1784405087.100751:0:22718:0:(import.c:65:import_set_state_nolock()) ffff9dd442697800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784405087.100789:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2007b688-b060-4b6f-9f62-4b541c93b597+6:2400:x1871083707978368:12345-192.168.202.42@tcp:38:mount.lustre.0 Request processed in 972us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405087.100797:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:0.0:1784405087.103025:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405087.103073:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405087.103159:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707978752 00000100:00100000:2.0:1784405087.103168:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707978752 00000100:00100000:2.0:1784405087.103224:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 43 00000100:00100000:2.0:1784405087.103234:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+7:2404:x1871083707978752:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784405087.103335:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+7:2404:x1871083707978752:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 103us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405087.103342:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 43 00000100:00100000:3.0:1784405087.103539:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707979008 00000100:00100000:3.0:1784405087.103544:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707979008 00000100:00100000:3.0:1784405087.103580:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:3.0:1784405087.103587:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:2404:x1871083707979008:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784405087.103617:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:2404:x1871083707979008:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 31us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405087.103624:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:3.0:1784405087.122375:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405087.122698:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707978240 00000100:00100000:0.0:1784405087.122709:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707978240 00000100:00100000:0.0:1784405087.122796:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:0.0:1784405087.122808:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2007b688-b060-4b6f-9f62-4b541c93b597+6:0:x1871083707978240:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784405087.122903:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1784405087.122971:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2007b688-b060-4b6f-9f62-4b541c93b597+6:0:x1871083707978240:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 164us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405087.122978:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00080000:1.0:1784405087.123997:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784405087.137340:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405087.137498:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707978624 00000100:00100000:2.0:1784405087.137508:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707978624 00000100:00100000:2.0:1784405087.137570:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:2.0:1784405087.137580:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2007b688-b060-4b6f-9f62-4b541c93b597+6:18205:x1871083707978624:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784405087.137613:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1784405087.137719:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2007b688-b060-4b6f-9f62-4b541c93b597+6:18205:x1871083707978624:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 139us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405087.137727:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:3.0:1784405087.148119:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405087.148425:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707978496 00000100:00100000:0.0:1784405087.148436:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707978496 00000100:00100000:0.0:1784405087.148513:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:0.0:1784405087.148524:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2007b688-b060-4b6f-9f62-4b541c93b597+6:0:x1871083707978496:12345-192.168.202.42@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784405087.148564:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784405087.148646:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2007b688-b060-4b6f-9f62-4b541c93b597+6:0:x1871083707978496:12345-192.168.202.42@tcp:41:mount.lustre.0 Request processed in 125us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405087.148654:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00080000:1.0:1784405087.150002:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784405087.153628:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405087.154364:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707979264 00000100:00100000:2.0:1784405087.154377:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707979264 00000100:00100000:2.0:1784405087.154450:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:2.0:1784405087.154461:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2007b688-b060-4b6f-9f62-4b541c93b597+6:18205:x1871083707979264:12345-192.168.202.42@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784405087.154552:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2007b688-b060-4b6f-9f62-4b541c93b597+6:18205:x1871083707979264:12345-192.168.202.42@tcp:40:mount.lustre.0 Request processed in 94us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405087.154560:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:1.0:1784405087.171834:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405087.172324:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405087.179752:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405087.179886:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707979648 00000100:00100000:0.0:1784405087.179897:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707979648 00000100:00100000:0.0:1784405087.179967:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:0.0:1784405087.179977:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2007b688-b060-4b6f-9f62-4b541c93b597+6:18205:x1871083707979648:12345-192.168.202.42@tcp:900:mount.lustre.0 00000100:00100000:0.0:1784405087.180068:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2007b688-b060-4b6f-9f62-4b541c93b597+6:18205:x1871083707979648:12345-192.168.202.42@tcp:900:mount.lustre.0 Request processed in 92us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405087.180075:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:3.0:1784405087.183457:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707979392 00000100:00100000:3.0:1784405087.183473:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707979392 00000100:00100000:0.0:1784405087.183716:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707979520 00000100:00100000:0.0:1784405087.183721:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707979520 00000100:00100000:0.0:1784405087.183765:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:0.0:1784405087.183775:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd577ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2400:x1871083707979392:12345-192.168.202.42@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784405087.183811:0:24222:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 2007b688-b060-4b6f-9f62-4b541c93b597@192.168.202.42@tcp t0 exp 0000000000000000 cur 705 last 0 00000020:00000080:0.0:1784405087.184420:0:24222:0:(genops.c:1385:class_connect()) connect: client 2007b688-b060-4b6f-9f62-4b541c93b597, cookie 0x24b3e2e6dcd7ac9f 00002000:00100000:0.0:1784405087.184449:0:24222:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2007b688-b060-4b6f-9f62-4b541c93b597/ffff9dd573e67800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784405087.184462:0:24222:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784405087.184535:0:24222:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784405087.184572:0:24222:0:(import.c:65:import_set_state_nolock()) ffff9dd573e62800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784405087.184641:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd577ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2007b688-b060-4b6f-9f62-4b541c93b597+6:2400:x1871083707979392:12345-192.168.202.42@tcp:8:mount.lustre.0 Request processed in 866us (12817us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405087.184650:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:0.0:1784405087.184674:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:0.0:1784405087.184680:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2400:x1871083707979520:12345-192.168.202.42@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784405087.184701:0:24222:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 2007b688-b060-4b6f-9f62-4b541c93b597@192.168.202.42@tcp t0 exp 0000000000000000 cur 705 last 0 00000020:00000080:0.0:1784405087.184718:0:24222:0:(genops.c:1385:class_connect()) connect: client 2007b688-b060-4b6f-9f62-4b541c93b597, cookie 0x24b3e2e6dcd7aca6 00002000:00100000:0.0:1784405087.184723:0:24222:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2007b688-b060-4b6f-9f62-4b541c93b597/ffff9dd573e60000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ae ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784405087.184729:0:24222:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784405087.184773:0:24222:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784405087.184788:0:24222:0:(import.c:65:import_set_state_nolock()) ffff9dd573e61800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784405087.184810:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2007b688-b060-4b6f-9f62-4b541c93b597+6:2400:x1871083707979520:12345-192.168.202.42@tcp:8:mount.lustre.0 Request processed in 129us (12486us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405087.184817:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:0.0:1784405087.184964:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405087.186686:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707979776 00000100:00100000:3.0:1784405087.186700:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707979776 00000100:00100000:3.0:1784405087.186766:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:3.0:1784405087.186777:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2007b688-b060-4b6f-9f62-4b541c93b597+6:18205:x1871083707979776:12345-192.168.202.42@tcp:33:mount.lustre.0 00000004:00200000:3.0:1784405087.186897:0:22721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1784405087.186985:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2007b688-b060-4b6f-9f62-4b541c93b597+6:18205:x1871083707979776:12345-192.168.202.42@tcp:33:mount.lustre.0 Request processed in 209us (2020us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405087.187233:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 1 00010000:00010000:1.0:1784405087.236726:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784405087.409276:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405087.409417:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707979904 00000100:00100000:3.0:1784405087.409428:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707979904 00000100:00100000:3.0:1784405087.409490:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:3.0:1784405087.409500:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2007b688-b060-4b6f-9f62-4b541c93b597+6:18238:x1871083707979904:12345-192.168.202.42@tcp:101:mkdir.0 00010000:00010000:3.0:1784405087.409524:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784405087.409546:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7acad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7826 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405087.409613:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151aa00/0x24b3e2e6dcd7acb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405087.409626:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151aa00/0x24b3e2e6dcd7acb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405087.409637:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151aa00/0x24b3e2e6dcd7acb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784405087.409679:0:22719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784405087.409683:0:22719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784405087.409713:0:22719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151aa00/0x24b3e2e6dcd7acb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405087.409748:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b000/0x24b3e2e6dcd7acad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7826 expref: 8 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405087.409767:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151aa00/0x24b3e2e6dcd7acb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7826 expref: 7 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405087.409776:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd544e47700) 00010000:00010000:3.0:1784405087.409779:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784405087.409782:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151aa00, rc 0) 00000100:00100000:3.0:1784405087.409838:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2007b688-b060-4b6f-9f62-4b541c93b597+7:18238:x1871083707979904:12345-192.168.202.42@tcp:101:mkdir.0 Request processed in 340us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405087.409846:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:2.0:1784405087.619425:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784405087.619453:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729053056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784405087.619544:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405087.619594:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729053056 00000100:00100000:2.0:1784405087.619603:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729053056 00000100:00100000:2.0:1784405087.619661:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784405087.619671:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729053056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784405087.619694:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1784405087.619742:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729053056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405087.619749:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784405087.619802:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729053056:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784405087.620118:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784405087.620130:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729053184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784405087.620176:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405087.620455:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729053184 00000100:00100000:3.0:1784405087.620460:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729053184 00000100:00100000:3.0:1784405087.620499:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784405087.620508:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729053184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784405087.620528:0:22722:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784405087.620566:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729053184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405087.620572:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784405087.620677:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729053312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784405087.620707:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405087.620774:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729053312 00000100:00100000:1.0:1784405087.620778:0:23457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729053312 00000100:00100000:1.0:1784405087.620807:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784405087.620812:0:23457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729053312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784405087.620824:0:23457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1784405087.620966:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729053312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784405087.620998:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729053184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784405087.621210:0:23457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729053312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 396us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405087.621217:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:1.0:1784405088.260383:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405089.288697:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784405089.603775:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784405090.183868:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729053440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784405090.183953:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405090.184035:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729053440 00000100:00100000:2.0:1784405090.184042:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729053440 00000100:00100000:2.0:1784405090.184100:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784405090.184111:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729053440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784405090.184154:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784405090.184209:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729053440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405090.184217:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1784405090.184250:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784405090.184280:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1784405090.184303:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd570590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729053440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784405090.186456:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729053696:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.186519:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405090.186559:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729054208:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.186583:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405090.186602:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083729054720:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.186624:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405090.186647:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784405090.186653:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3647:1871083729053568:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.186689:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405090.186711:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729054080:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.186733:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405090.186750:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083729054592:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.186768:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405090.186798:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729053696 00000100:00100000:1.0:1784405090.186805:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729053696 00000100:00100000:1.0:1784405090.186845:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729054080 00000100:00100000:1.0:1784405090.186872:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729054080 00000100:00100000:1.0:1784405090.186891:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784405090.186898:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729053696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.186960:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729053696:12345-0@lo:400:kworker.0 Request processed in 61us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405090.186968:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784405090.186986:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784405090.186991:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729054080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.187015:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729054080:12345-0@lo:400:kworker.0 Request processed in 25us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405090.187020:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784405090.187038:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729054208 00000100:00100000:1.0:1784405090.187042:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729054208 00000100:00100000:1.0:1784405090.187080:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784405090.187086:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729054208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.187116:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729054208:12345-0@lo:400:kworker.0 Request processed in 30us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405090.187121:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784405090.187147:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729054720 00000100:00100000:1.0:1784405090.187150:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729054720 00000100:00100000:1.0:1784405090.187178:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729054592 00000100:00100000:1.0:1784405090.187180:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729054592 00000100:00100000:1.0:1784405090.187200:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784405090.187206:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083729054720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.187252:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1871083729054720:12345-0@lo:400:kworker.0 Request processed in 46us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405090.187259:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784405090.187270:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784405090.187276:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083729054592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.187316:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1871083729054592:12345-0@lo:400:kworker.0 Request processed in 39us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405090.187322:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784405090.187341:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729053568 00000100:00100000:1.0:1784405090.187345:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729053568 00000100:00100000:1.0:1784405090.187371:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784405090.187376:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:3647:x1871083729053568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.187404:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:3647:x1871083729053568:12345-0@lo:400:kworker.0 Request processed in 28us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405090.187409:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1784405090.187454:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784405090.187458:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784405090.187462:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784405090.187472:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083729053952:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.187499:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405090.187518:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083729054464:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.187549:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405090.187565:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083729054976:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.187585:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405090.187602:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784405090.187609:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729053824:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.187630:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405090.187647:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729054336:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.187666:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405090.187683:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083729054848:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.187717:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405090.187743:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729053824 00000100:00100000:1.0:1784405090.187748:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729053824 00000100:00100000:1.0:1784405090.187773:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729054336 00000100:00100000:1.0:1784405090.187775:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729054336 00000100:00100000:1.0:1784405090.187796:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784405090.187801:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573e77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729053824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.187832:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573e77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729053824:12345-0@lo:400:kworker.0 Request processed in 31us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405090.187838:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784405090.187870:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784405090.187877:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573e76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729054336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.187905:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573e76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729054336:12345-0@lo:400:kworker.0 Request processed in 29us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405090.187911:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784405090.187929:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729053952 00000100:00100000:1.0:1784405090.187932:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729053952 00000100:00100000:1.0:1784405090.187955:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729054464 00000100:00100000:1.0:1784405090.187958:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729054464 00000100:00100000:1.0:1784405090.187968:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729054976 00000100:00100000:1.0:1784405090.187970:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729054976 00000100:00100000:1.0:1784405090.187986:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729054848 00000100:00100000:1.0:1784405090.187988:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729054848 00000100:00100000:1.0:1784405090.188002:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784405090.188007:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083729053952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.188038:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1871083729053952:12345-0@lo:400:kworker.0 Request processed in 30us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405090.188043:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784405090.188053:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784405090.188058:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573e75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083729054464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.188081:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573e75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1871083729054464:12345-0@lo:400:kworker.0 Request processed in 23us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405090.188087:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784405090.188097:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784405090.188101:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083729054976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.188124:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1871083729054976:12345-0@lo:400:kworker.0 Request processed in 22us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405090.188128:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784405090.188138:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784405090.188143:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083729054848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.188168:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1871083729054848:12345-0@lo:400:kworker.0 Request processed in 25us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405090.188174:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1784405090.188197:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784405090.188206:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784405090.188209:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784405090.188210:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784405090.188260:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3647:1871083729053568:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.188277:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729054080:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.188289:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1871083729054592:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.188302:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729053696:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.188313:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729054208:0@lo:400:kworker.0 00010000:00080000:1.0:1784405090.188325:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd573e76a00 x1871083729054720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405090.188336:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1871083729054720:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.188378:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729053824:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.188387:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729054336:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.188395:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1871083729054848:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.188405:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1871083729053952:0@lo:400:kworker.0 00000100:00100000:1.0:1784405090.188413:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1871083729054464:0@lo:400:kworker.0 00010000:00080000:1.0:1784405090.188422:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd573e74e00 x1871083729054976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784405090.188431:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1871083729054976:0@lo:400:kworker.0 00000001:00100000:0.0:1784405090.189977:0:23448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2007b688-b060-4b6f-9f62-4b541c93b597 00000001:00100000:0.0:1784405090.189991:0:23448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4bfe57d2-0189-4fcc-8706-d3fc83c1de0c 00000001:00100000:0.0:1784405090.190999:0:22696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2007b688-b060-4b6f-9f62-4b541c93b597 00000001:00100000:0.0:1784405090.191012:0:22696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4bfe57d2-0189-4fcc-8706-d3fc83c1de0c 00000100:00100000:0.0:1784405090.191409:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729055104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784405090.191484:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405090.191574:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729055104 00000100:00100000:2.0:1784405090.191583:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729055104 00000100:00100000:2.0:1784405090.191639:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784405090.191651:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729055104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784405090.191674:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784405090.191724:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729055104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405090.191732:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784405090.191778:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729055104:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1784405090.208759:0:24219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2007b688-b060-4b6f-9f62-4b541c93b597 00000001:00100000:1.0:1784405090.208774:0:24219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4bfe57d2-0189-4fcc-8706-d3fc83c1de0c 00010000:00010000:1.0:1784405090.313626:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784405090.668576:0:25596:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1784405091.331260:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784405091.718032:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729055232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784405091.718114:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405091.719584:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729055232 00000100:00100000:3.0:1784405091.719595:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729055232 00000100:00100000:3.0:1784405091.719660:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784405091.719670:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729055232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784405091.719723:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1784405091.719864:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729055232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 180us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405091.719872:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784405091.720192:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729055232:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784405092.358598:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784405092.558816:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405092.563703:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405092.563732:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405092.563764:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405092.563794:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707980288 00000100:00100000:0.0:1784405092.563804:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707980288 00000100:00100000:0.0:1784405092.563883:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707980800 00000100:00100000:0.0:1784405092.563887:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707980800 00000100:00100000:0.0:1784405092.563914:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 50 00000100:00100000:0.0:1784405092.563925:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:2402:x1871083707980288:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784405092.564005:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:2402:x1871083707980288:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 81us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405092.564012:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 50 00000100:00100000:0.0:1784405092.564032:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:0.0:1784405092.564052:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2007b688-b060-4b6f-9f62-4b541c93b597+5:2402:x1871083707980800:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784405092.564080:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2007b688-b060-4b6f-9f62-4b541c93b597+5:2402:x1871083707980800:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 29us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405092.564086:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00080000:0.0:1784405092.564116:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784405092.564146:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405092.564200:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405092.564298:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405092.564318:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405092.564338:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405092.564357:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707980544 00000100:00100000:0.0:1784405092.564360:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707980544 00000100:00100000:0.0:1784405092.564385:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707981056 00000100:00100000:0.0:1784405092.564388:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707981056 00000100:00100000:0.0:1784405092.564398:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707980416 00000100:00100000:0.0:1784405092.564400:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707980416 00000100:00100000:0.0:1784405092.564412:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707980928 00000100:00100000:0.0:1784405092.564415:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707980928 00000100:00100000:0.0:1784405092.564434:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:0.0:1784405092.564441:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:2402:x1871083707980544:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784405092.564473:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:2402:x1871083707980544:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 32us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405092.564480:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:0.0:1784405092.564492:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:0.0:1784405092.564497:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2007b688-b060-4b6f-9f62-4b541c93b597+6:2402:x1871083707981056:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784405092.564517:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2007b688-b060-4b6f-9f62-4b541c93b597+6:2402:x1871083707981056:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 20us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405092.564532:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:0.0:1784405092.564543:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:0.0:1784405092.564549:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:2402:x1871083707980416:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784405092.564586:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:2402:x1871083707980416:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 36us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405092.564592:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:0.0:1784405092.564602:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:0.0:1784405092.564608:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2007b688-b060-4b6f-9f62-4b541c93b597+5:2402:x1871083707980928:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784405092.564627:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2007b688-b060-4b6f-9f62-4b541c93b597+5:2402:x1871083707980928:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 19us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405092.564632:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:0.0:1784405092.564646:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707980160 00000100:00100000:0.0:1784405092.564649:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707980160 00000100:00100000:0.0:1784405092.564671:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707980672 00000100:00100000:0.0:1784405092.564673:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707980672 00000100:00100000:0.0:1784405092.564686:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:0.0:1784405092.564691:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:2402:x1871083707980160:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784405092.564717:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:2402:x1871083707980160:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 26us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405092.564724:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:0.0:1784405092.564736:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:0.0:1784405092.564741:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd565e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2007b688-b060-4b6f-9f62-4b541c93b597+6:2402:x1871083707980672:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784405092.564761:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd565e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2007b688-b060-4b6f-9f62-4b541c93b597+6:2402:x1871083707980672:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 20us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405092.564773:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00080000:0.0:1784405092.564795:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784405092.564799:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784405092.564800:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784405092.567572:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707980032 00000100:00100000:1.0:1784405092.567586:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707980032 00000100:00100000:1.0:1784405092.567646:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 146 00000100:00100000:1.0:1784405092.567656:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:2402:x1871083707980032:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784405092.567741:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:2402:x1871083707980032:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 86us (8933us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405092.567749:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 146 00000100:00100000:2.0:1784405092.742071:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784405092.742102:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729055360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784405092.742186:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405092.742250:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729055360 00000100:00100000:2.0:1784405092.742257:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729055360 00000100:00100000:2.0:1784405092.742306:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784405092.742317:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729055360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784405092.742353:0:22722:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784405092.742402:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729055360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405092.742410:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784405092.742477:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729055360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784405092.745643:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729055488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784405092.745729:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405092.746958:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729055488 00000100:00100000:1.0:1784405092.746971:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729055488 00000100:00100000:1.0:1784405092.747051:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784405092.747062:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729055488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784405092.747088:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1784405092.747158:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729055488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405092.747166:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1784405092.748241:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784405092.748308:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729055488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784405092.749537:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729055616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784405092.749612:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405092.754744:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729055616 00000100:00100000:1.0:1784405092.754761:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729055616 00000100:00100000:1.0:1784405092.756450:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784405092.756473:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729055616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784405092.756521:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1784405092.756624:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729055616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 161us (7011us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405092.756649:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784405092.758740:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729055616:0@lo:41:osp-pre-0-1.0 00000001:00100000:3.0:1784405093.254771:0:25040:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2007b688-b060-4b6f-9f62-4b541c93b597 00010000:00010000:1.0:1784405093.380453:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784405093.635711:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1784405093.949565:0:25744:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffcba2a040 20000000:00000080:2.0:1784405093.949585:0:25744:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dd573e5a400 uarg=0000000000000000 20000000:01000000:2.0:1784405093.949626:0:25744:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784405093.949632:0:25744:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784405093.949636:0:25744:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1784405093.950321:0:25745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1784405093.950457:0:25744:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1784405093.956817:0:25744:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784405093.957377:0:25744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd7acbb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.957401:0:25744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd4425c7800/0x24b3e2e6dcd7a918 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a911 expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.957410:0:25744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd4425c7200/0x24b3e2e6dcd7a926 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a91f expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.957418:0:25744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a965 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7a95e expref: 23 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.957425:0:25744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd4425c6600/0x24b3e2e6dcd7aadf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7aad8 expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.957436:0:25744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd57331dc00/0x24b3e2e6dcd7ac4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7785 expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.957444:0:25744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ac8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed77f5 expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.957473:0:25744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd7acbb lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.957530:0:25744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ac8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed77f5 expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.957548:0:25744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ac8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed77f5 expref: 12 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405093.957565:0:25744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732e8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1871083729055744:192.168.202.42@tcp:104: 00010000:00010000:0.0:1784405093.957694:0:25744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd57331dc00/0x24b3e2e6dcd7ac4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7785 expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.957702:0:25744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd57331dc00/0x24b3e2e6dcd7ac4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7785 expref: 12 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405093.957711:0:25744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732e9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1871083729055872:192.168.202.42@tcp:104: 00010000:00010000:0.0:1784405093.957742:0:25744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd4425c6600/0x24b3e2e6dcd7aadf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7aad8 expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.957751:0:25744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd4425c6600/0x24b3e2e6dcd7aadf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7aad8 expref: 23 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405093.957759:0:25744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732eaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1871083729056000:0@lo:104: 00000100:00100000:0.0:1784405093.957798:0:25744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784405093.957841:0:25744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a95e expref: 23 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.957893:0:25744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a965 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a95e expref: 23 pid: 22712 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405093.957901:0:25744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1871083729056128:0@lo:104: 00000100:00100000:0.0:1784405093.957925:0:25744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405093.957968:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729056000 00000100:00100000:0.0:1784405093.957976:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729056000 00000100:00100000:0.0:1784405093.958014:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729056128 00000100:00100000:0.0:1784405093.958016:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729056128 00000100:00100000:0.0:1784405093.958033:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784405093.958041:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+4:25744:x1871083729056000:12345-0@lo:104: 00010000:00010000:0.0:1784405093.958052:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd57331d200/0x24b3e2e6dcd7aad8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7aadf expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.958107:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784405093.958113:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+4:25744:x1871083729056000:12345-0@lo:104: Request processed in 73us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405093.958120:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784405093.958138:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784405093.958144:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+3:25744:x1871083729056128:12345-0@lo:104: 00010000:00010000:0.0:1784405093.958151:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd442056a00/0x24b3e2e6dcd7a95e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a965 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.958179:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784405093.958184:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+3:25744:x1871083729056128:12345-0@lo:104: Request processed in 41us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405093.958188:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1784405093.958222:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784405093.958227:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd57331d200/0x24b3e2e6dcd7aad8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7aadf expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.958233:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331d200 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784405093.958237:0:22706:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd57331d200/0x24b3e2e6dcd7aad8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7aadf expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.958244:0:22706:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd57331d200/0x24b3e2e6dcd7aad8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7aadf expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784405093.958251:0:22706:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd57331d200/0x24b3e2e6dcd7aad8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7aadf expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784405093.958256:0:22706:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784405093.958281:0:22706:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd57331d200/0x24b3e2e6dcd7aad8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7aadf expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.958287:0:22706:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784405093.958303:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd57331d200/0x24b3e2e6dcd7aad8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7aadf expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.958310:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd57331d200/0x24b3e2e6dcd7aad8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7aadf expref: -99 pid: 25039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.958322:0:22706:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784405093.958325:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd442056a00/0x24b3e2e6dcd7a95e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a965 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.958331:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056a00 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:0.0:1784405093.958333:0:22706:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd442056a00/0x24b3e2e6dcd7a95e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a965 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.958347:0:22706:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd442056a00/0x24b3e2e6dcd7a95e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a965 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784405093.958353:0:22706:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd442056a00/0x24b3e2e6dcd7a95e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a965 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784405093.958358:0:22706:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784405093.958368:0:22706:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd442056a00/0x24b3e2e6dcd7a95e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a965 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.958373:0:22706:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784405093.958385:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd442056a00/0x24b3e2e6dcd7a95e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a965 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.958390:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd442056a00/0x24b3e2e6dcd7a95e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a965 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.958398:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405093.958400:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784405093.958401:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784405093.958414:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3647:1871083729056256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784405093.958442:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405093.958477:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784405093.958484:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3649:1871083729056384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784405093.958506:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405093.958532:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729056256 00000100:00100000:0.0:1784405093.958535:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729056256 00010000:00010000:0.0:1784405093.958551:0:22703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd4425c6600/0x24b3e2e6dcd7aadf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7aad8 expref: 24 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405093.958579:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729056384 00000100:00100000:0.0:1784405093.958582:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729056384 00010000:00010000:0.0:1784405093.958593:0:22703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a965 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a95e expref: 25 pid: 22712 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405093.958605:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784405093.958610:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+25:3647:x1871083729056256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784405093.958620:0:22703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784405093.958625:0:22703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd4425c6600/0x24b3e2e6dcd7aadf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7aad8 expref: 25 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.958634:0:22703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd4425c6600/0x24b3e2e6dcd7aadf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7aad8 expref: 25 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.958651:0:22703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784405093.958678:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+25:3647:x1871083729056256:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405093.958684:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784405093.958697:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784405093.958704:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:3649:x1871083729056384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784405093.958710:0:22703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784405093.958714:0:22703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a965 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a95e expref: 24 pid: 22712 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.958722:0:22703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a965 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a95e expref: 24 pid: 22712 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.958731:0:22703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784405093.958763:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:3649:x1871083729056384:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405093.958769:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784405093.958800:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3649:1871083729056384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784405093.958823:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3647:1871083729056256:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784405093.958848:0:25744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd4425c7200/0x24b3e2e6dcd7a926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a91f expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.958892:0:25744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd4425c7200/0x24b3e2e6dcd7a926 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a91f expref: 23 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405093.958901:0:25744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732e9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1871083729056512:0@lo:104: 00000100:00100000:0.0:1784405093.958922:0:25744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405093.958942:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729056512 00000100:00100000:0.0:1784405093.958946:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729056512 00000100:00100000:0.0:1784405093.958961:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784405093.958967:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+3:25744:x1871083729056512:12345-0@lo:104: 00010000:00010000:0.0:1784405093.958975:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6000/0x24b3e2e6dcd7a91f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a926 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.959004:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784405093.959008:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+3:25744:x1871083729056512:12345-0@lo:104: Request processed in 42us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405093.959015:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1784405093.959043:0:25744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dd4425c7800/0x24b3e2e6dcd7a918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x24b3e2e6dcd7a911 expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.959051:0:25744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dd4425c7800/0x24b3e2e6dcd7a918 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a911 expref: 23 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405093.959067:0:25744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5732ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1871083729056640:0@lo:104: 00000100:00100000:0.0:1784405093.959091:0:25744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405093.959110:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729056640 00000100:00100000:0.0:1784405093.959113:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729056640 00000100:00100000:0.0:1784405093.959129:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784405093.959134:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+3:25744:x1871083729056640:12345-0@lo:104: 00010000:00010000:0.0:1784405093.959141:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6400/0x24b3e2e6dcd7a911 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a918 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405093.959169:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784405093.959174:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+3:25744:x1871083729056640:12345-0@lo:104: Request processed in 40us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405093.959179:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1784405093.959704:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784405093.959711:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6000/0x24b3e2e6dcd7a91f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a926 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405093.959719:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6000 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784405093.959722:0:22705:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6000/0x24b3e2e6dcd7a91f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a926 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405093.959730:0:22705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6000/0x24b3e2e6dcd7a91f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a926 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784405093.959736:0:22705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6000/0x24b3e2e6dcd7a91f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a926 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784405093.959742:0:22705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784405093.959763:0:22705:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6000/0x24b3e2e6dcd7a91f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a926 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405093.959768:0:22705:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784405093.959792:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6000/0x24b3e2e6dcd7a91f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a926 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405093.959799:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6000/0x24b3e2e6dcd7a91f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a926 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405093.959811:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784405093.959820:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6400/0x24b3e2e6dcd7a911 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x24b3e2e6dcd7a918 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405093.959826:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd4425c6400 already unused, calling callback (ffffffffc148ec20) 10000000:00010000:1.0:1784405093.959829:0:22705:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6400/0x24b3e2e6dcd7a911 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x24b3e2e6dcd7a918 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405093.959836:0:22705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6400/0x24b3e2e6dcd7a911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x24b3e2e6dcd7a918 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784405093.959842:0:22705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6400/0x24b3e2e6dcd7a911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x24b3e2e6dcd7a918 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784405093.959847:0:22705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784405093.959877:0:22705:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6400/0x24b3e2e6dcd7a911 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a918 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405093.959883:0:22705:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784405093.959894:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6400/0x24b3e2e6dcd7a911 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a918 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405093.959900:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.142@tcp lock: ffff9dd4425c6400/0x24b3e2e6dcd7a911 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x24b3e2e6dcd7a918 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405093.959913:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405093.959914:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784405093.959916:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784405093.959928:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3646:1871083729056896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784405093.960057:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405093.960088:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784405093.960163:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3648:1871083729056768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784405093.960204:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405093.960228:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729056896 00000100:00100000:1.0:1784405093.960233:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729056896 00010000:00010000:1.0:1784405093.960253:0:22702:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd4425c7800/0x24b3e2e6dcd7a918 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a911 expref: 24 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405093.960269:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729056768 00000100:00100000:1.0:1784405093.960272:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729056768 00010000:00010000:1.0:1784405093.960282:0:22702:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd4425c7200/0x24b3e2e6dcd7a926 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a91f expref: 25 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405093.960294:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784405093.960300:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+25:3646:x1871083729056896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784405093.960309:0:22702:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784405093.960314:0:22702:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd4425c7800/0x24b3e2e6dcd7a918 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a911 expref: 25 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405093.960322:0:22702:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd4425c7800/0x24b3e2e6dcd7a918 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a911 expref: 25 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405093.960336:0:22702:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784405093.960365:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+25:3646:x1871083729056896:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405093.960372:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784405093.960388:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784405093.960393:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573e74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:3648:x1871083729056768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784405093.960400:0:22702:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784405093.960404:0:22702:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd4425c7200/0x24b3e2e6dcd7a926 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a91f expref: 24 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405093.960421:0:22702:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd4425c7200/0x24b3e2e6dcd7a926 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a91f expref: 24 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405093.960430:0:22702:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784405093.960457:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573e74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:3648:x1871083729056768:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405093.960462:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1784405093.960480:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784405093.960503:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3648:1871083729056768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784405093.960524:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3646:1871083729056896:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784405093.964740:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784405093.964776:0:25744:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b8f900 going to sleep for 11 seconds 00010000:00010000:0.0:1784405093.964819:0:25744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd4425c6600/0x24b3e2e6dcd7aadf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7aad8 expref: 23 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405093.964884:0:25744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732eaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1871083729056000:0@lo:104: 00010000:00010000:0.0:1784405093.964900:0:25744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd443549e00/0x24b3e2e6dcd7a965 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a95e expref: 22 pid: 22712 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405093.964910:0:25744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1871083729056128:0@lo:104: 00010000:00010000:0.0:1784405093.964920:0:25744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd4425c7200/0x24b3e2e6dcd7a926 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a91f expref: 21 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405093.964929:0:25744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732e9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1871083729056512:0@lo:104: 00010000:00010000:0.0:1784405093.964970:0:25744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd4425c7800/0x24b3e2e6dcd7a918 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x24b3e2e6dcd7a911 expref: 20 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405093.964978:0:25744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1871083729056640:0@lo:104: 00000100:00100000:0.0:1784405093.966439:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405093.966573:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707981184 00000100:00100000:2.0:1784405093.966581:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707981184 00010000:00010000:2.0:1784405093.966619:0:22704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ac8a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed77f5 expref: 13 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405093.966658:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:2.0:1784405093.966666:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57cedfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:2404:x1871083707981184:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784405093.966679:0:22704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784405093.966685:0:22704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ac8a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed77f5 expref: 13 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405093.966696:0:22704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ac8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed77f5 expref: 13 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405093.966726:0:22704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784405093.966777:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57cedfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:2404:x1871083707981184:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 112us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405093.966784:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 13 00010000:00010000:1.0:1784405093.967005:0:25744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd5821db600/0x24b3e2e6dcd7ac8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed77f5 expref: 12 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405093.967018:0:25744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732e8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1871083729055744:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784405093.967027:0:25744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5732e9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1871083729055872:192.168.202.42@tcp:104: 00010000:00010000:1.0:1784405093.967059:0:25744:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd7acbb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405093.975184:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405093.975907:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707981312 00000100:00100000:3.0:1784405093.975918:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707981312 00010000:00010000:3.0:1784405093.976127:0:22704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dd57331dc00/0x24b3e2e6dcd7ac4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7785 expref: 12 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405093.976183:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:3.0:1784405093.976203:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+12:2404:x1871083707981312:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784405093.976218:0:22704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784405093.976224:0:22704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dd57331dc00/0x24b3e2e6dcd7ac4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7785 expref: 12 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405093.976237:0:22704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dd57331dc00/0x24b3e2e6dcd7ac4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7785 expref: 12 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405093.976255:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd57331dc00/0x24b3e2e6dcd7ac4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7785 expref: 12 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405093.976271:0:22704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd7acbb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405093.976279:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd7acbb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405093.976295:0:22704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd7acbb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405093.976326:0:22704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd7acbb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405093.976332:0:22704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd7acbb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405093.976338:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd7acbb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405093.976344:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821db200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:3.0:1784405093.976349:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd7acbb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405093.976356:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd7acbb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405093.976375:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd7acbb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405093.976385:0:22704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784405093.976439:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+11:2404:x1871083707981312:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 246us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405093.976447:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 14 00010000:00010000:2.0:1784405093.977649:0:25744:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd7acbb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405093.977679:0:25744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd7acbb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405093.977686:0:25744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dd5821db200/0x24b3e2e6dcd7acbb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405094.410922:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784405095.299939:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729057408:0@lo:400:kworker.0 00000100:00100000:1.0:1784405095.300002:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729057152:0@lo:400:kworker.0 00000100:00100000:3.0:1784405095.300023:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405095.300062:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3647:1871083729057024:0@lo:400:kworker.0 00000100:00100000:2.0:1784405095.300154:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729057280:0@lo:400:kworker.0 00000100:00100000:1.0:1784405095.309608:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405095.309655:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729057664:0@lo:400:kworker.0 00000100:00100000:1.0:1784405095.309699:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405095.309721:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083729058176:0@lo:400:kworker.0 00000100:00100000:1.0:1784405095.312405:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405095.312528:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729058688:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784405095.312585:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405095.312629:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729057152 00000100:00100000:1.0:1784405095.312635:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729057152 00000100:00100000:1.0:1784405095.312672:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729057664 00000100:00100000:1.0:1784405095.312675:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729057664 00000100:00100000:1.0:1784405095.312692:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784405095.312699:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c92bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729057152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405095.312753:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c92bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729057152:12345-0@lo:400:kworker.0 Request processed in 54us (3154us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405095.312758:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784405095.315109:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784405095.315130:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57c928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729057664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405095.315323:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57c928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729057664:12345-0@lo:400:kworker.0 Request processed in 197us (5618us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405095.315331:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784405095.315374:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729058688 00000100:00100000:1.0:1784405095.315382:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729058688 00000100:00100000:1.0:1784405095.315439:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784405095.315445:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729058688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784405095.315468:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784405095.315748:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729058688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 302us (3161us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405095.315755:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1784405095.315788:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784405095.315829:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729058688:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784405095.315842:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729057152:0@lo:400:kworker.0 00000100:00100000:1.0:1784405095.315890:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729057664:0@lo:400:kworker.0 00000100:00100000:1.0:1784405095.315958:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729057408 00000100:00100000:1.0:1784405095.315963:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729057408 00000100:00100000:1.0:1784405095.315996:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784405095.316002:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083729057408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405095.319683:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083729057408:12345-0@lo:400:kworker.0 Request processed in 3670us (19650us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405095.319697:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1784405095.319879:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784405095.319922:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729058176 00000100:00100000:1.0:1784405095.319931:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729058176 00000100:00100000:1.0:1784405095.319987:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784405095.319995:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083729058176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405095.320073:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083729058176:12345-0@lo:400:kworker.0 Request processed in 79us (7676us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405095.320079:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1784405095.320094:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784405095.320128:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083729058176:0@lo:400:kworker.0 00000100:00100000:3.0:1784405095.321010:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729057408:0@lo:400:kworker.0 00000100:00100000:3.0:1784405095.321041:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729057920:0@lo:400:kworker.0 00000100:00100000:3.0:1784405095.321087:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405095.321125:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083729058432:0@lo:400:kworker.0 00000100:00100000:3.0:1784405095.321155:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784405095.321190:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729057920 00000100:00100000:1.0:1784405095.321198:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729057920 00000100:00100000:1.0:1784405095.321390:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729058432 00000100:00100000:1.0:1784405095.321394:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729058432 00000100:00100000:1.0:1784405095.321439:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784405095.321447:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083729058432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405095.321838:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083729058432:12345-0@lo:400:kworker.0 Request processed in 318us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405095.321886:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1784405095.321908:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784405095.321928:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784405095.321936:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729057920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784405095.321972:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729057920:12345-0@lo:400:kworker.0 Request processed in 37us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405095.321978:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784405095.322233:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729057920:0@lo:400:kworker.0 00000100:00100000:3.0:1784405095.322245:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083729058432:0@lo:400:kworker.0 00000100:00100000:0.0:1784405095.323369:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405095.323431:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083729057536:0@lo:400:kworker.0 00000100:00100000:0.0:1784405095.323464:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405095.323499:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729057536 00000100:00100000:0.0:1784405095.323507:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729057536 00000100:00100000:0.0:1784405095.323553:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784405095.323562:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083729057536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405095.323610:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1871083729057536:12345-0@lo:400:kworker.0 Request processed in 48us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405095.323616:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784405095.323657:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1871083729057536:0@lo:400:kworker.0 00000100:00100000:0.0:1784405095.323664:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083729058048:0@lo:400:kworker.0 00000100:00100000:0.0:1784405095.323683:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405095.323713:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729058048 00000100:00100000:0.0:1784405095.323717:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729058048 00000100:00100000:0.0:1784405095.323739:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784405095.323745:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083729058048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405095.323775:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1871083729058048:12345-0@lo:400:kworker.0 Request processed in 30us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405095.323781:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784405095.323822:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1871083729058048:0@lo:400:kworker.0 00000100:00100000:0.0:1784405095.323829:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083729058560:0@lo:400:kworker.0 00000100:00100000:0.0:1784405095.323873:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405095.323891:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729058560 00000100:00100000:0.0:1784405095.323895:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729058560 00000100:00100000:0.0:1784405095.323923:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784405095.323930:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083729058560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405095.323956:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1871083729058560:12345-0@lo:400:kworker.0 Request processed in 27us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405095.323962:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1784405095.323977:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1784405095.323993:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c929880 x1871083729058560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784405095.324003:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1871083729058560:0@lo:400:kworker.0 00000100:00100000:2.0:1784405095.324103:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405095.324135:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729057792:0@lo:400:kworker.0 00000100:00100000:2.0:1784405095.324159:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405095.324190:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd57c92ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083729058304:0@lo:400:kworker.0 00000100:00100000:2.0:1784405095.324214:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405095.324215:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729057280 00000100:00100000:0.0:1784405095.324221:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729057280 00000100:00100000:2.0:1784405095.324239:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729058304 00000100:00100000:2.0:1784405095.324244:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729058304 00000100:00100000:0.0:1784405095.324257:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729057792 00000100:00100000:0.0:1784405095.324262:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729057792 00000100:00100000:2.0:1784405095.324281:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784405095.324290:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784405095.324293:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083729058304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405095.324302:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729057280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405095.324333:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1871083729058304:12345-0@lo:400:kworker.0 Request processed in 43us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405095.324341:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784405095.324349:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729057280:12345-0@lo:400:kworker.0 Request processed in 49us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405095.324357:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784405095.324375:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1784405095.324376:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd57c92ad80 x1871083729058304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784405095.324385:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729057792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405095.324393:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1871083729058304:0@lo:400:kworker.0 00000100:00100000:2.0:1784405095.324403:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd574d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729058816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784405095.324420:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1871083729057792:12345-0@lo:400:kworker.0 Request processed in 36us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405095.324438:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729057024 00000100:00100000:0.0:1784405095.324438:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784405095.324441:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405095.324443:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729057024 00000100:00080000:0.0:1784405095.324455:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784405095.324460:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784405095.324479:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784405095.324484:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729058816 00000100:00100000:2.0:1784405095.324491:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729058816 00000100:00100000:2.0:1784405095.324536:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784405095.324543:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729058816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784405095.324560:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784405095.324591:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1871083729058816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405095.324598:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784405095.324626:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd574d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729058816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784405095.324650:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1871083729057280:0@lo:400:kworker.0 00000100:00100000:2.0:1784405095.324660:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd57c92a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1871083729057792:0@lo:400:kworker.0 00000100:00100000:3.0:1784405095.324679:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+20:3647:x1871083729057024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784405095.324732:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+20:3647:x1871083729057024:12345-0@lo:400:kworker.0 Request processed in 246us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405095.324740:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784405095.324755:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3647:1871083729057024:0@lo:400:kworker.0 00010000:00010000:1.0:1784405095.428519:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784405095.473723:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405095.473842:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707981440 00000100:00100000:0.0:1784405095.473888:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707981440 00000100:00100000:0.0:1784405095.476403:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:0.0:1784405095.476429:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:18707:x1871083707981440:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784405095.476452:0:24942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405095.476477:0:24942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821da000/0x24b3e2e6dcd7acc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed782d expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476544:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acc9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476559:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476573:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476587:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7acd0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476595:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7acd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476602:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7acd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476690:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dac00/0x24b3e2e6dcd7acd7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476712:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dac00/0x24b3e2e6dcd7acd7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476720:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dac00/0x24b3e2e6dcd7acd7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784405095.476752:0:24942:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784405095.476756:0:24942:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784405095.476790:0:24942:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dac00/0x24b3e2e6dcd7acd7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476801:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476808:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acc9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476815:0:24942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476822:0:24942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821dbc00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784405095.476826:0:24942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476834:0:24942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acc9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476847:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd544e47700) 00010000:00010000:0.0:1784405095.476870:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784405095.476875:0:24942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476891:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476909:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7acd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476915:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7acd0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476921:0:24942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7acd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476926:0:24942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821dae00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784405095.476929:0:24942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7acd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476934:0:24942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7acd0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.476942:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9dd57067d500) 00010000:00010000:0.0:1784405095.478202:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784405095.478210:0:24942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7acd0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.478219:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7acd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.478274:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821da000/0x24b3e2e6dcd7acc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed782d expref: 8 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.478305:0:24942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dac00/0x24b3e2e6dcd7acd7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed782d expref: 7 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.478313:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dd57067dd00) 00010000:00010000:0.0:1784405095.478315:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784405095.478317:0:24942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd5821dac00, rc 0) 00000100:00100000:0.0:1784405095.478406:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+7:18707:x1871083707981440:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 1988us (4692us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405095.478414:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00080000:2.0:1784405095.478591:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784405095.491600:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405095.491815:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707981568 00000100:00100000:1.0:1784405095.491830:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707981568 00000100:00100000:1.0:1784405095.492245:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:1.0:1784405095.492257:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+7:18707:x1871083707981568:12345-192.168.202.42@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1784405095.492354:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+7:18707:x1871083707981568:12345-192.168.202.42@tcp:900:lhsmtool_posix.0 Request processed in 99us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405095.492363:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:1.0:1784405095.505191:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405095.505317:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707981696 00000100:00100000:0.0:1784405095.505377:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707981696 00000100:00100000:0.0:1784405095.505466:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 148 00000100:00100000:0.0:1784405095.505477:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+11:18087:x1871083707981696:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784405095.505494:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405095.505515:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd5821da000/0x24b3e2e6dcd7acde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7834 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.505542:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd5821da000/0x24b3e2e6dcd7acde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7834 expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.505552:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd5821da000/0x24b3e2e6dcd7acde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7834 expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.505560:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd5821da000, rc 0) 00000100:00100000:0.0:1784405095.505615:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+12:18087:x1871083707981696:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 Request processed in 140us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405095.505637:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 148 00000100:00100000:2.0:1784405095.505945:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405095.506001:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707981952 00000100:00100000:0.0:1784405095.506005:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707981952 00000100:00100000:0.0:1784405095.506119:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:0.0:1784405095.506128:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+7:18707:x1871083707981952:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784405095.506142:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405095.506156:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7ace5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed783b expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.506242:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acec lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.506255:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.506266:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.506279:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821db600/0x24b3e2e6dcd7acf3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.506286:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821db600/0x24b3e2e6dcd7acf3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.506292:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821db600/0x24b3e2e6dcd7acf3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.506646:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821db200/0x24b3e2e6dcd7acfa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.506669:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821db200/0x24b3e2e6dcd7acfa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.506676:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821db200/0x24b3e2e6dcd7acfa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784405095.506686:0:22718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1784405095.506824:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.506831:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acec lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.506838:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.506844:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821dbc00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784405095.506848:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.506980:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acec lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.506992:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dd57067dd00) 00010000:00010000:0.0:1784405095.506995:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784405095.506999:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.507005:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dbc00/0x24b3e2e6dcd7acec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.507020:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821db600/0x24b3e2e6dcd7acf3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.507031:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821db600/0x24b3e2e6dcd7acf3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.507113:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821db600/0x24b3e2e6dcd7acf3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.507120:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821db600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784405095.507124:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821db600/0x24b3e2e6dcd7acf3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.507130:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821db600/0x24b3e2e6dcd7acf3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.507138:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9dd57067d000) 00010000:00010000:0.0:1784405095.507141:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784405095.507144:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821db600/0x24b3e2e6dcd7acf3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.507150:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821db600/0x24b3e2e6dcd7acf3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.509787:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7ace5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed783b expref: 10 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.509820:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821db200/0x24b3e2e6dcd7acfa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed783b expref: 9 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.509829:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd57067d600) 00010000:00010000:0.0:1784405095.509832:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784405095.509844:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd5821db200, rc 0) 00000100:00100000:0.0:1784405095.510065:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+9:18707:x1871083707981952:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 3937us (4118us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1784405095.510075:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:2.0:1784405095.518556:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405095.518650:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707982080 00000100:00100000:3.0:1784405095.518663:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707982080 00000100:00100000:3.0:1784405095.518792:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 149 00000100:00100000:3.0:1784405095.518805:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+12:18087:x1871083707982080:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784405095.519492:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+12:18087:x1871083707982080:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 Request processed in 686us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405095.519502:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 149 00000100:00100000:3.0:1784405095.522603:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405095.522692:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707982208 00000100:00100000:1.0:1784405095.522704:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707982208 00000100:00100000:1.0:1784405095.522768:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:1.0:1784405095.522780:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+9:18707:x1871083707982208:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1784405095.522912:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+9:18707:x1871083707982208:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 Request processed in 134us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405095.522921:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:0.0:1784405095.532135:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405095.533106:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707982336 00000100:00100000:2.0:1784405095.533121:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707982336 00000100:00100000:2.0:1784405095.533247:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:2.0:1784405095.533258:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:18707:x1871083707982336:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1784405095.533778:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405095.533877:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707982464 00000100:00100000:2.0:1784405095.533883:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707982464 00000100:00100000:2.0:1784405095.533922:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 150 00000100:00100000:2.0:1784405095.533931:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+12:18087:x1871083707982464:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784405095.534068:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+12:18087:x1871083707982464:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 Request processed in 138us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405095.534078:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 150 00000004:00080000:2.0:1784405095.536195:0:22719:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2889us 00000100:00080000:0.0:1784405095.539845:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784405095.543059:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405095.543144:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707982592 00000100:00100000:1.0:1784405095.543162:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707982592 00000100:00100000:1.0:1784405095.543237:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:1.0:1784405095.543248:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+9:18713:x1871083707982592:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1784405095.543270:0:24942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784405095.543294:0:24942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7842 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543371:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543387:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543415:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543476:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543485:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543493:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543544:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543564:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543571:0:24942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543585:0:24942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331c800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784405095.543589:0:24942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543597:0:24942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543611:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd544e47700) 00010000:00010000:1.0:1784405095.543614:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784405095.543619:0:24942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543625:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543639:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543645:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543651:0:24942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543657:0:24942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331de00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784405095.543660:0:24942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543666:0:24942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543687:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9dd54a6b8f00) 00010000:00010000:1.0:1784405095.543690:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784405095.543693:0:24942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543700:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543735:0:24942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7842 expref: 10 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543746:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd544e47700) 00010000:00010000:1.0:1784405095.543749:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784405095.543753:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7842 expref: 10 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.543762:0:24942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331c200, rc 0) 00000100:00100000:1.0:1784405095.543844:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+9:18713:x1871083707982592:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 598us (793us total) trans 0 rc 301/301 00000100:00100000:1.0:1784405095.543886:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:2.0:1784405095.553416:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405095.553471:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405095.553677:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707982720 00000100:00100000:0.0:1784405095.553686:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707982720 00000100:00100000:0.0:1784405095.553746:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 151 00000100:00100000:0.0:1784405095.553756:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+12:18087:x1871083707982720:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784405095.553772:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405095.553792:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd5821dbc00/0x24b3e2e6dcd7ad1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7849 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.553822:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd5821dbc00/0x24b3e2e6dcd7ad1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7849 expref: 13 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.553846:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd5821dbc00/0x24b3e2e6dcd7ad1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7849 expref: 13 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.553876:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd5821dbc00, rc 0) 00000100:00100000:1.0:1784405095.553909:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707982848 00000100:00100000:1.0:1784405095.553913:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707982848 00000100:00100000:0.0:1784405095.553933:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574e58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:18087:x1871083707982720:12345-192.168.202.42@tcp:101:ll_cfg_requeue.0 Request processed in 178us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405095.553940:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 151 00000100:00100000:1.0:1784405095.553965:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:1.0:1784405095.553972:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+9:18713:x1871083707982848:12345-192.168.202.42@tcp:700:lfs.0 00000100:00100000:1.0:1784405095.554008:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+9:18713:x1871083707982848:12345-192.168.202.42@tcp:700:lfs.0 Request processed in 36us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405095.554014:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:0.0:1784405095.557910:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405095.558066:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707982976 00000100:00100000:2.0:1784405095.558078:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707982976 00000100:00100000:2.0:1784405095.558138:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 152 00000100:00100000:2.0:1784405095.558148:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:18087:x1871083707982976:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784405095.558326:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:18087:x1871083707982976:12345-192.168.202.42@tcp:501:ll_cfg_requeue.0 Request processed in 178us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405095.558334:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 152 00000100:00100000:0.0:1784405095.562594:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405095.562643:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405095.562741:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707983360 00000100:00100000:2.0:1784405095.562751:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707983360 00000100:00100000:2.0:1784405095.562825:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 153 00000100:00100000:2.0:1784405095.562846:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:18087:x1871083707983360:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784405095.563005:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:18087:x1871083707983360:12345-192.168.202.42@tcp:503:ll_cfg_requeue.0 Request processed in 170us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405095.563014:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 153 00000100:00100000:1.0:1784405095.564215:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707983232 00000100:00100000:1.0:1784405095.564225:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707983232 00000100:00100000:1.0:1784405095.564283:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:1.0:1784405095.564294:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+9:18713:x1871083707983232:12345-192.168.202.42@tcp:36:lfs.0 00010000:00010000:1.0:1784405095.564348:0:22718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784405095.564374:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a400/0x24b3e2e6dcd7ac75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed77b6 expref: 9 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.564391:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd544e47700) 00010000:00010000:1.0:1784405095.564395:0:22718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784405095.564451:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad24 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.564464:0:22718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151aa00/0x24b3e2e6dcd7acb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7826 expref: 5 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.564472:0:22718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad24 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.564505:0:22718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151aa00/0x24b3e2e6dcd7acb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7826 expref: 5 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.564518:0:22718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151aa00/0x24b3e2e6dcd7acb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7826 expref: 5 pid: 22719 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405095.564531:0:22718:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5445e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22718:1871083729058944:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784405095.564600:0:22718:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5510af300 going to sleep for 11 seconds 00000100:00100000:2.0:1784405095.569373:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:18707:x1871083707982336:12345-192.168.202.42@tcp:59:lhsmtool_posix.0 Request processed in 36107us (37236us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405095.569389:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 26 00000100:00100000:2.0:1784405095.577259:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405095.577351:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707983488 00000100:00100000:0.0:1784405095.577361:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707983488 00000100:00100000:1.0:1784405095.577379:0:22718:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5445e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22718:1871083729058944:192.168.202.42@tcp:104: 00010000:00010000:1.0:1784405095.577418:0:22718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad24 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.577453:0:22703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151aa00/0x24b3e2e6dcd7acb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7826 expref: 6 pid: 22719 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405095.577494:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:0.0:1784405095.577504:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2007b688-b060-4b6f-9f62-4b541c93b597+6:2404:x1871083707983488:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784405095.577521:0:22703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784405095.577528:0:22703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151aa00/0x24b3e2e6dcd7acb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7826 expref: 6 pid: 22719 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.577541:0:22703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151aa00/0x24b3e2e6dcd7acb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7826 expref: 6 pid: 22719 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.577562:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151aa00/0x24b3e2e6dcd7acb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7826 expref: 6 pid: 22719 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.577577:0:22703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd544e47700) 00010000:00010000:0.0:1784405095.577582:0:22703:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad24 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.577593:0:22703:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.577600:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad24 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.577631:0:22703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784405095.577684:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2007b688-b060-4b6f-9f62-4b541c93b597+5:2404:x1871083707983488:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 181us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405095.577701:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 15 00010000:00010000:1.0:1784405095.578824:0:22718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.578861:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.578889:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad2b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.578900:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.578910:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784405095.579492:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784405095.581828:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad32 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.581897:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad32 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.581911:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad32 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784405095.581988:0:22718:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c160ac4d reply state 000000000bf00bd0 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad32 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.582004:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad32 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.582011:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd54a6b8d00) 00010000:00010000:2.0:1784405095.582014:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784405095.582018:0:22718:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784405095.582025:0:22718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784405095.582044:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.582051:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad24 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.582057:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad24 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.582070:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331c200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784405095.582138:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad24 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.582148:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad24 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.582160:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd544e47700) 00010000:00010000:2.0:1784405095.582162:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784405095.582166:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad24 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.582196:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad24 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784405095.582219:0:22718:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c160ac4d reply state 000000000bf00bd0 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.582229:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.582235:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9dd54a6b8f00) 00010000:00010000:2.0:1784405095.582238:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784405095.582240:0:22718:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1784405095.582385:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+10:18713:x1871083707983232:12345-192.168.202.42@tcp:36:lfs.0 Request processed in 18089us (19797us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1784405095.582394:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:2.0:1784405095.672137:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405095.672363:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707983616 00000100:00100000:1.0:1784405095.672377:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707983616 00000100:00100000:1.0:1784405095.672451:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:1.0:1784405095.672464:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+10:18723:x1871083707983616:12345-192.168.202.42@tcp:101:lctl.0 00010000:00010000:1.0:1784405095.672495:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784405095.672537:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7850 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.672613:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d800/0x24b3e2e6dcd7ad40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.672629:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d800/0x24b3e2e6dcd7ad40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.672642:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d800/0x24b3e2e6dcd7ad40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784405095.672685:0:22717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784405095.672690:0:22717:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784405095.672726:0:22717:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d800/0x24b3e2e6dcd7ad40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.672752:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ad39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7850 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.672772:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d800/0x24b3e2e6dcd7ad40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7850 expref: 11 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.672782:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54a6b8900) 00010000:00010000:1.0:1784405095.672784:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784405095.672788:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331d800, rc 0) 00000100:00100000:1.0:1784405095.672917:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+11:18723:x1871083707983616:12345-192.168.202.42@tcp:101:lctl.0 Request processed in 455us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405095.672925:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 29 00000040:00080000:2.0:1784405095.687005:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784405095.698304:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405095.698470:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707983744 00000100:00100000:2.0:1784405095.698479:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707983744 00000100:00100000:2.0:1784405095.698571:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:2.0:1784405095.698583:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2007b688-b060-4b6f-9f62-4b541c93b597+5:18724:x1871083707983744:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1784405095.698604:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784405095.698624:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7ad47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7857 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.698693:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056e00/0x24b3e2e6dcd7ad4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.698707:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056e00/0x24b3e2e6dcd7ad4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.698733:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056e00/0x24b3e2e6dcd7ad4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784405095.698783:0:22719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784405095.698786:0:22719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784405095.698804:0:22719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056e00/0x24b3e2e6dcd7ad4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.698827:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7ad47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7857 expref: 7 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.698844:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056e00/0x24b3e2e6dcd7ad4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7857 expref: 6 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.698900:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54a6b8900) 00010000:00010000:2.0:1784405095.698903:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784405095.698906:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442056e00, rc 0) 00000100:00100000:2.0:1784405095.698973:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2007b688-b060-4b6f-9f62-4b541c93b597+6:18724:x1871083707983744:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 393us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405095.698980:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:3.0:1784405095.702662:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405095.702741:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707983872 00000100:00100000:0.0:1784405095.702752:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707983872 00000100:00100000:0.0:1784405095.702821:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:0.0:1784405095.702833:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2007b688-b060-4b6f-9f62-4b541c93b597+6:18724:x1871083707983872:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1784405095.702880:0:24942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405095.702904:0:24942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821db600/0x24b3e2e6dcd7ad55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed785e expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.702994:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7ad5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703009:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7ad5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703022:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7ad5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703035:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209c00/0x24b3e2e6dcd7ad63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703041:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209c00/0x24b3e2e6dcd7ad63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703047:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209c00/0x24b3e2e6dcd7ad63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703127:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208e00/0x24b3e2e6dcd7ad6a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703152:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208e00/0x24b3e2e6dcd7ad6a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703160:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208e00/0x24b3e2e6dcd7ad6a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784405095.703218:0:24942:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784405095.703223:0:24942:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784405095.703251:0:24942:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208e00/0x24b3e2e6dcd7ad6a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703263:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7ad5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703270:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7ad5c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703276:0:24942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7ad5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703283:0:24942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd5821dae00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784405095.703288:0:24942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7ad5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703296:0:24942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7ad5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703309:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54a6b8900) 00010000:00010000:0.0:1784405095.703312:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784405095.703316:0:24942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7ad5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703343:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821dae00/0x24b3e2e6dcd7ad5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703359:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209c00/0x24b3e2e6dcd7ad63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703365:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209c00/0x24b3e2e6dcd7ad63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703371:0:24942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209c00/0x24b3e2e6dcd7ad63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703376:0:24942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d209c00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784405095.703379:0:24942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209c00/0x24b3e2e6dcd7ad63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703386:0:24942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209c00/0x24b3e2e6dcd7ad63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703393:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9dd54a6b8f00) 00010000:00010000:0.0:1784405095.703396:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784405095.703399:0:24942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209c00/0x24b3e2e6dcd7ad63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703405:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209c00/0x24b3e2e6dcd7ad63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703434:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd5821db600/0x24b3e2e6dcd7ad55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed785e expref: 8 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703462:0:24942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208e00/0x24b3e2e6dcd7ad6a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed785e expref: 7 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.703470:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd54a6b8d00) 00010000:00010000:0.0:1784405095.703473:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784405095.703475:0:24942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd56d208e00, rc 0) 00000100:00100000:0.0:1784405095.703555:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2007b688-b060-4b6f-9f62-4b541c93b597+7:18724:x1871083707983872:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 719us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405095.703563:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:1.0:1784405095.706291:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405095.706403:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707984000 00000100:00100000:0.0:1784405095.706414:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707984000 00000100:00100000:0.0:1784405095.706561:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:0.0:1784405095.706573:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2007b688-b060-4b6f-9f62-4b541c93b597+5:18724:x1871083707984000:12345-192.168.202.42@tcp:900:lfs.0 00000100:00100000:0.0:1784405095.706667:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2007b688-b060-4b6f-9f62-4b541c93b597+5:18724:x1871083707984000:12345-192.168.202.42@tcp:900:lfs.0 Request processed in 96us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405095.706676:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00080000:2.0:1784405095.707186:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784405095.709998:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405095.710138:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707984256 00000100:00100000:0.0:1784405095.710149:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707984256 00000100:00100000:0.0:1784405095.710227:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 32 00000100:00100000:0.0:1784405095.710238:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2007b688-b060-4b6f-9f62-4b541c93b597+7:18724:x1871083707984256:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1784405095.710260:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405095.710284:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209c00/0x24b3e2e6dcd7ad71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7865 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784405095.710393:0:22718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784405095.710524:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209c00/0x24b3e2e6dcd7ad71 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7865 expref: 9 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.710540:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54a6b8900) 00010000:00010000:0.0:1784405095.710543:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784405095.710548:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209c00/0x24b3e2e6dcd7ad71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7865 expref: 9 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.710566:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd56d209c00, rc 0) 00000100:00100000:0.0:1784405095.710637:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2007b688-b060-4b6f-9f62-4b541c93b597+8:18724:x1871083707984256:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 401us (649us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1784405095.710645:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 32 00000100:00100000:3.0:1784405095.713459:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405095.713549:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707984512 00000100:00100000:0.0:1784405095.713560:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707984512 00000100:00100000:0.0:1784405095.713624:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:0.0:1784405095.713636:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2007b688-b060-4b6f-9f62-4b541c93b597+8:18724:x1871083707984512:12345-192.168.202.42@tcp:36:lfs.0 00010000:00010000:0.0:1784405095.713697:0:24942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784405095.713729:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208e00/0x24b3e2e6dcd7ad6a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed785e expref: 8 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.713754:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd54a6b8d00) 00010000:00010000:0.0:1784405095.713759:0:24942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784405095.713783:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208800/0x24b3e2e6dcd7ad7f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.713795:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208800/0x24b3e2e6dcd7ad7f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.713804:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208800/0x24b3e2e6dcd7ad7f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784405095.714457:0:24942:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d80a7602 reply state 00000000797fb1e8 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208800/0x24b3e2e6dcd7ad7f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.714475:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208800/0x24b3e2e6dcd7ad7f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.714483:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd54a6b8d00) 00010000:00010000:0.0:1784405095.714485:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1784405095.714488:0:24942:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784405095.714498:0:24942:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1784405095.714588:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2007b688-b060-4b6f-9f62-4b541c93b597+9:18724:x1871083707984512:12345-192.168.202.42@tcp:36:lfs.0 Request processed in 952us (1136us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1784405095.714596:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 33 00000100:00100000:1.0:1784405095.718980:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405095.719148:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707984768 00000100:00100000:3.0:1784405095.719162:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707984768 00000100:00100000:3.0:1784405095.719243:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:3.0:1784405095.719256:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2007b688-b060-4b6f-9f62-4b541c93b597+9:18724:x1871083707984768:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:3.0:1784405095.719535:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2007b688-b060-4b6f-9f62-4b541c93b597+10:18724:x1871083707984768:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 280us (564us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1784405095.719556:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:2.0:1784405095.724395:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405095.724498:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707985024 00000100:00100000:0.0:1784405095.724508:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707985024 00000100:00100000:0.0:1784405095.724569:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:0.0:1784405095.724580:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2007b688-b060-4b6f-9f62-4b541c93b597+10:18724:x1871083707985024:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:0.0:1784405095.724606:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405095.724627:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208e00/0x24b3e2e6dcd7ad86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed786c expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.724711:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208a00/0x24b3e2e6dcd7ad8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.724726:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208a00/0x24b3e2e6dcd7ad8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.724737:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208a00/0x24b3e2e6dcd7ad8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.724765:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209200/0x24b3e2e6dcd7ad94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.724773:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209200/0x24b3e2e6dcd7ad94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.724780:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209200/0x24b3e2e6dcd7ad94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784405095.725437:0:22718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784405095.725537:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208a00/0x24b3e2e6dcd7ad8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.725546:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208a00/0x24b3e2e6dcd7ad8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.725552:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208a00/0x24b3e2e6dcd7ad8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.725559:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d208a00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784405095.725564:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208a00/0x24b3e2e6dcd7ad8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.725572:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208a00/0x24b3e2e6dcd7ad8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.725586:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54a6b8900) 00010000:00010000:0.0:1784405095.725588:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784405095.725592:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208a00/0x24b3e2e6dcd7ad8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.725610:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208a00/0x24b3e2e6dcd7ad8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.725628:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209200/0x24b3e2e6dcd7ad94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.725635:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209200/0x24b3e2e6dcd7ad94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.725641:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209200/0x24b3e2e6dcd7ad94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.725646:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d209200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784405095.725649:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209200/0x24b3e2e6dcd7ad94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.725654:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209200/0x24b3e2e6dcd7ad94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.725661:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9dd54a6b8f00) 00010000:00010000:0.0:1784405095.725664:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784405095.725666:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209200/0x24b3e2e6dcd7ad94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.725672:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209200/0x24b3e2e6dcd7ad94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.725707:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208e00/0x24b3e2e6dcd7ad86 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed786c expref: 12 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.725726:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54a6b8900) 00010000:00010000:0.0:1784405095.725728:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784405095.725732:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208e00/0x24b3e2e6dcd7ad86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed786c expref: 12 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.725741:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd56d208e00, rc 0) 00000100:00100000:0.0:1784405095.725833:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2007b688-b060-4b6f-9f62-4b541c93b597+11:18724:x1871083707985024:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 1255us (1448us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1784405095.726440:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 34 00000100:00100000:0.0:1784405095.729743:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405095.729922:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707985152 00000100:00100000:1.0:1784405095.729936:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707985152 00000100:00100000:1.0:1784405095.730002:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 35 00000100:00100000:1.0:1784405095.730016:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2007b688-b060-4b6f-9f62-4b541c93b597+11:18724:x1871083707985152:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:1.0:1784405095.730312:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784405095.730344:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7ada2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7873 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.730468:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331dc00/0x24b3e2e6dcd7ada9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.730488:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331dc00/0x24b3e2e6dcd7ada9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.730501:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331dc00/0x24b3e2e6dcd7ada9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784405095.730532:0:22717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784405095.730536:0:22717:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784405095.730556:0:22717:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331dc00/0x24b3e2e6dcd7ada9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.730583:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331ca00/0x24b3e2e6dcd7ada2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7873 expref: 13 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.730604:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331dc00/0x24b3e2e6dcd7ada9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7873 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.730613:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd54a6b8d00) 00010000:00010000:1.0:1784405095.730636:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784405095.730640:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331dc00, rc 0) 00000100:00100000:1.0:1784405095.730717:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2007b688-b060-4b6f-9f62-4b541c93b597+12:18724:x1871083707985152:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 703us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405095.730724:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 35 00000100:00100000:1.0:1784405095.736162:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405095.736254:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707985280 00000100:00100000:3.0:1784405095.736264:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707985280 00000100:00100000:3.0:1784405095.736343:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:3.0:1784405095.736353:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2007b688-b060-4b6f-9f62-4b541c93b597+12:18724:x1871083707985280:12345-192.168.202.42@tcp:37:lfs.0 00000100:00100000:3.0:1784405095.742517:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2007b688-b060-4b6f-9f62-4b541c93b597+12:18724:x1871083707985280:12345-192.168.202.42@tcp:37:lfs.0 Request processed in 6153us (6356us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405095.742534:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:0.0:1784405095.746319:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405095.746409:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707985536 00000100:00100000:1.0:1784405095.746421:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707985536 00000100:00100000:1.0:1784405095.746509:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 4 00000100:00100000:1.0:1784405095.746520:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570651450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2007b688-b060-4b6f-9f62-4b541c93b597+12:18724:x1871083707985536:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:1.0:1784405095.746763:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570651450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2007b688-b060-4b6f-9f62-4b541c93b597+13:18724:x1871083707985536:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 244us (453us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1784405095.746772:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 4 00000040:00080000:0.0:1784405095.749696:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1784405095.750021:0:22714:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784405095.750026:0:22714:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd443141800 from 13 10000000:01000000:2.0:1784405095.750029:0:22714:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784405095.750089:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442057600/0x24b3e2e6dcd7adb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.750121:0:22714:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd442057600/0x24b3e2e6dcd7adb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.750132:0:22714:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd442057600/0x24b3e2e6dcd7adb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405095.750158:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729059072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784405095.750241:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405095.750287:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd570601480 going to sleep for 11 seconds 00000100:00100000:0.0:1784405095.750561:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729059072 00000100:00100000:0.0:1784405095.750569:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729059072 00000100:00100000:0.0:1784405095.750613:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784405095.750622:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+20:22714:x1871083729059072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784405095.750635:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405095.750647:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd56d209200/0x24b3e2e6dcd7adb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7adb0 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.750668:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd56d209200/0x24b3e2e6dcd7adb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7adb0 expref: 21 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.750678:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd56d209200/0x24b3e2e6dcd7adb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7adb0 expref: 21 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.750686:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd56d209200, rc 0) 00000100:00100000:0.0:1784405095.750743:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:22714:x1871083729059072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405095.750749:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784405095.750847:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729059072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784405095.750891:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd442057600/0x24b3e2e6dcd7adb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7adb7 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.750900:0:22714:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd442057600/0x24b3e2e6dcd7adb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7adb7 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405095.750962:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729059200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784405095.750993:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405095.751012:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd558ed0840 going to sleep for 11 seconds 00000100:00100000:0.0:1784405095.751260:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729059200 00000100:00100000:0.0:1784405095.751264:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729059200 00000100:00100000:0.0:1784405095.751298:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784405095.751305:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:22714:x1871083729059200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784405095.751428:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:22714:x1871083729059200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405095.751435:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784405095.751549:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729059200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784405095.751585:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729059328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784405095.751627:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405095.751650:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd558ed0840 going to sleep for 11 seconds 00000100:00100000:3.0:1784405095.751664:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729059328 00000100:00100000:3.0:1784405095.751668:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729059328 00000100:00100000:3.0:1784405095.751735:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784405095.751750:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:22714:x1871083729059328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784405095.752049:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:22714:x1871083729059328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405095.752056:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784405095.760030:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729059328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784405095.764311:0:25758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1784405095.764586:0:22714:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1784405095.764614:0:22714:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784405095.764628:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442057600/0x24b3e2e6dcd7adb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7adb7 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.764640:0:22714:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd442057600/0x24b3e2e6dcd7adb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7adb7 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784405095.764650:0:22714:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784405095.764653:0:22714:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd573843800 from 13 10000000:01000000:2.0:1784405095.764657:0:22714:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784405095.764696:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7adbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.764704:0:22714:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7adbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.764715:0:22714:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7adbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405095.764747:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cde300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729059456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784405095.764813:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405095.764895:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5706016c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784405095.765023:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729059456 00000100:00100000:0.0:1784405095.765032:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729059456 00000100:00100000:0.0:1784405095.765097:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784405095.765109:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+21:22714:x1871083729059456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784405095.765126:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405095.765146:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd7adc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7adbe expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.765184:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd7adc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7adbe expref: 22 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.765198:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd56d208a00/0x24b3e2e6dcd7adc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7adbe expref: 22 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.765208:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd56d208a00, rc 0) 00000100:00100000:0.0:1784405095.765262:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+22:22714:x1871083729059456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405095.765271:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784405095.765463:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cde300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729059456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784405095.765481:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7adbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7adc5 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.765490:0:22714:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7adbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7adc5 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405095.765559:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729059584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784405095.765588:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405095.765619:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443770840 going to sleep for 11 seconds 00000100:00100000:2.0:1784405095.765792:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729059584 00000100:00100000:2.0:1784405095.765796:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729059584 00000100:00100000:2.0:1784405095.765832:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784405095.765839:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+22:22714:x1871083729059584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784405095.766189:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+22:22714:x1871083729059584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405095.766197:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784405095.766599:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729059584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784405095.766669:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729059712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784405095.766716:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405095.766794:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443770840 going to sleep for 11 seconds 00000100:00100000:0.0:1784405095.774385:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729059712 00000100:00100000:0.0:1784405095.774408:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729059712 00000100:00100000:0.0:1784405095.774495:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784405095.774509:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+22:22714:x1871083729059712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784405095.775414:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+22:22714:x1871083729059712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 895us (8684us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405095.775425:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784405095.775545:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729059712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784405095.777619:0:25759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1784405095.777888:0:22714:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1784405095.777921:0:22714:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784405095.777934:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7adbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7adc5 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.777945:0:22714:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd442056c00/0x24b3e2e6dcd7adbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7adc5 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784405095.777955:0:22714:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784405095.777957:0:22714:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd54851a800 from 13 10000000:01000000:2.0:1784405095.777960:0:22714:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784405095.778007:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7adcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.778016:0:22714:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7adcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.778027:0:22714:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7adcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405095.778082:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443cde300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729059840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784405095.778164:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405095.778213:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729059840 00000100:00100000:2.0:1784405095.778219:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd5706016c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784405095.778223:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729059840 00000100:00100000:0.0:1784405095.778343:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1784405095.778354:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+22:22714:x1871083729059840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784405095.778371:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405095.778386:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd56d209e00/0x24b3e2e6dcd7add3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7adcc expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.778410:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd56d209e00/0x24b3e2e6dcd7add3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7adcc expref: 23 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.778421:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd56d209e00/0x24b3e2e6dcd7add3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7adcc expref: 23 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.778429:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd56d209e00, rc 0) 00000100:00100000:0.0:1784405095.778480:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:22714:x1871083729059840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405095.778488:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784405095.779068:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443cde300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729059840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784405095.779097:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7adcc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7add3 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.779107:0:22714:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7adcc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7add3 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405095.779197:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729059968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784405095.779230:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405095.779262:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443c13000 going to sleep for 11 seconds 00000100:00100000:1.0:1784405095.779286:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729059968 00000100:00100000:1.0:1784405095.779291:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729059968 00000100:00100000:1.0:1784405095.779337:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784405095.779345:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:22714:x1871083729059968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784405095.779477:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:22714:x1871083729059968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405095.779484:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784405095.779588:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729059968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784405095.779618:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729060096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784405095.779657:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405095.779668:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443c13000 going to sleep for 11 seconds 00000100:00100000:2.0:1784405095.780086:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729060096 00000100:00100000:2.0:1784405095.780092:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729060096 00000100:00100000:2.0:1784405095.780133:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784405095.780141:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd546270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:22714:x1871083729060096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784405095.780251:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd546270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:22714:x1871083729060096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405095.780259:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1784405095.780284:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729060096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784405095.781322:0:25760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1784405095.781406:0:22714:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1784405095.781436:0:22714:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784405095.781448:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7adcc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7add3 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.781460:0:22714:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd442056800/0x24b3e2e6dcd7adcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7add3 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784405095.781470:0:22714:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784405095.781472:0:22714:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9dd442282800 from 13 10000000:01000000:3.0:1784405095.781475:0:22714:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784405095.781508:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151b000/0x24b3e2e6dcd7adda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.781517:0:22714:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.142@tcp lock: ffff9dd58151b000/0x24b3e2e6dcd7adda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.781525:0:22714:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.142@tcp lock: ffff9dd58151b000/0x24b3e2e6dcd7adda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405095.781559:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729060224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784405095.781605:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405095.781698:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443c13000 going to sleep for 11 seconds 00000100:00100000:0.0:1784405095.781795:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729060224 00000100:00100000:0.0:1784405095.781802:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729060224 00000100:00100000:0.0:1784405095.782030:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784405095.782149:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+23:22714:x1871083729060224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784405095.782172:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784405095.782197:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dd57331ca00/0x24b3e2e6dcd7ade1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x24b3e2e6dcd7adda expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.782223:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dd57331ca00/0x24b3e2e6dcd7ade1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7adda expref: 24 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.782233:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dd57331ca00/0x24b3e2e6dcd7ade1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x24b3e2e6dcd7adda expref: 24 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.782242:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331ca00, rc 0) 00000100:00100000:1.0:1784405095.782285:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:22714:x1871083729060224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 247us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405095.782293:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784405095.782325:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729060224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784405095.782341:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.142@tcp lock: ffff9dd58151b000/0x24b3e2e6dcd7adda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7ade1 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.782350:0:22714:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.142@tcp lock: ffff9dd58151b000/0x24b3e2e6dcd7adda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x24b3e2e6dcd7ade1 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405095.782412:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729060352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784405095.782440:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405095.782469:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443c13000 going to sleep for 11 seconds 00000100:00100000:1.0:1784405095.783051:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729060352 00000100:00100000:1.0:1784405095.783058:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729060352 00000100:00100000:1.0:1784405095.783170:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1784405095.783189:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:22714:x1871083729060352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784405095.783317:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:22714:x1871083729060352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405095.783326:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784405095.783351:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729060352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784405095.783388:0:22714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729060480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784405095.783436:0:22714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405095.783473:0:22714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443c13000 going to sleep for 11 seconds 00000100:00100000:1.0:1784405095.783515:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729060480 00000100:00100000:1.0:1784405095.783520:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729060480 00000100:00100000:1.0:1784405095.783583:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1784405095.783592:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:22714:x1871083729060480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784405095.783694:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:22714:x1871083729060480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405095.783710:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784405095.783786:0:22714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:22714:1871083729060480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784405095.790040:0:25761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1784405095.790143:0:22714:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1784405095.790188:0:22714:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784405095.790200:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.142@tcp lock: ffff9dd58151b000/0x24b3e2e6dcd7adda lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7ade1 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.790211:0:22714:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.142@tcp lock: ffff9dd58151b000/0x24b3e2e6dcd7adda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x24b3e2e6dcd7ade1 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405095.802740:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405095.802927:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707985664 00000100:00100000:2.0:1784405095.802938:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707985664 00000100:00100000:2.0:1784405095.803008:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:2.0:1784405095.803019:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+11:18730:x1871083707985664:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:2.0:1784405095.803043:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784405095.803068:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7ade8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed787a expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803145:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7adef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803160:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7adef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803200:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7adef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803214:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7adf6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803221:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7adf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803227:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7adf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803318:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7adfd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803327:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7adfd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803334:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7adfd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784405095.803387:0:22719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784405095.803391:0:22719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784405095.803431:0:22719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7adfd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803443:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7adef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803451:0:22719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7adef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803468:0:22719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7adef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803474:0:22719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784405095.803479:0:22719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7adef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803487:0:22719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7adef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803500:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54a6b8900) 00010000:00010000:2.0:1784405095.803503:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784405095.803508:0:22719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7adef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803515:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7adef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803528:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7adf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803534:0:22719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7adf6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803540:0:22719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7adf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803544:0:22719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057e00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784405095.803547:0:22719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7adf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803560:0:22719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7adf6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803568:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9dd54a6b8f00) 00010000:00010000:2.0:1784405095.803570:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784405095.803573:0:22719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7adf6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803579:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7adf6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803604:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7ade8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed787a expref: 13 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803616:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056a00/0x24b3e2e6dcd7adfd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed787a expref: 12 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.803623:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd54a6b8d00) 00010000:00010000:2.0:1784405095.803625:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784405095.803627:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442056a00, rc 0) 00000100:00100000:2.0:1784405095.803694:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+12:18730:x1871083707985664:12345-192.168.202.42@tcp:101:bash.0 Request processed in 677us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405095.803701:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 36 00000100:00100000:2.0:1784405095.808490:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405095.809217:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707985792 00000100:00100000:0.0:1784405095.809228:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707985792 00000100:00100000:0.0:1784405095.809294:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:0.0:1784405095.809305:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:18730:x1871083707985792:12345-192.168.202.42@tcp:900:bash.0 00000100:00100000:0.0:1784405095.809408:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:18730:x1871083707985792:12345-192.168.202.42@tcp:900:bash.0 Request processed in 104us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405095.809417:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:0.0:1784405095.813707:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405095.813796:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707986048 00000100:00100000:1.0:1784405095.813807:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707986048 00000100:00100000:1.0:1784405095.813901:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 37 00000100:00100000:1.0:1784405095.813913:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+12:18730:x1871083707986048:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1784405095.813951:0:24942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784405095.813984:0:24942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7ae04 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7881 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.814136:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae0b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.814156:0:24942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331dc00/0x24b3e2e6dcd7ada9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7873 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.814168:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae0b lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.814223:0:24942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331dc00/0x24b3e2e6dcd7ada9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7873 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.814238:0:24942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331dc00/0x24b3e2e6dcd7ada9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7873 expref: 12 pid: 22717 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405095.814257:0:24942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5445e0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24942:1871083729060608:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784405095.814364:0:24942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd545b21000 going to sleep for 11 seconds 00000100:00100000:1.0:1784405095.819151:0:24942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5445e0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24942:1871083729060608:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784405095.819165:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00010000:00010000:1.0:1784405095.819201:0:24942:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae0b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405095.819933:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707986176 00000100:00100000:3.0:1784405095.822009:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707986176 00010000:00010000:3.0:1784405095.822075:0:22702:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331dc00/0x24b3e2e6dcd7ada9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7873 expref: 13 pid: 22717 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405095.822184:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 16 00000100:00100000:3.0:1784405095.822196:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2007b688-b060-4b6f-9f62-4b541c93b597+13:2404:x1871083707986176:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784405095.822214:0:22702:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784405095.822221:0:22702:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331dc00/0x24b3e2e6dcd7ada9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7873 expref: 13 pid: 22717 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.822234:0:22702:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331dc00/0x24b3e2e6dcd7ada9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7873 expref: 13 pid: 22717 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.822259:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331dc00/0x24b3e2e6dcd7ada9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7873 expref: 13 pid: 22717 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.822279:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd54a6b8d00) 00010000:00010000:3.0:1784405095.822284:0:22702:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae0b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.822295:0:22702:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae0b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.822303:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae0b lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.822336:0:22702:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784405095.822437:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2007b688-b060-4b6f-9f62-4b541c93b597+12:2404:x1871083707986176:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 243us (3275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405095.822453:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 16 00010000:00010000:1.0:1784405095.824301:0:24942:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae0b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.824318:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae0b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.824401:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7ae12 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.824415:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7ae12 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.824427:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7ae12 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.824993:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c400/0x24b3e2e6dcd7ae19 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.825003:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c400/0x24b3e2e6dcd7ae19 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.825010:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c400/0x24b3e2e6dcd7ae19 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784405095.825023:0:24942:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784405095.825054:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae0b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.825062:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae0b lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.825085:0:24942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae0b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.825091:0:24942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331d200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784405095.825096:0:24942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae0b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.825103:0:24942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae0b lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.825117:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd54a6b8d00) 00010000:00010000:1.0:1784405095.825120:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784405095.825125:0:24942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae0b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.825132:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae0b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784405095.825148:0:24942:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000044d28376 reply state 000000006603dab6 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7ae12 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.825159:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7ae12 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.825166:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9dd54a6b8500) 00010000:00010000:1.0:1784405095.825168:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784405095.825172:0:24942:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784405095.825225:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7ae04 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7881 expref: 15 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.825240:0:24942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c400/0x24b3e2e6dcd7ae19 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7881 expref: 14 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.825253:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:1.0:1784405095.825255:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1784405095.825258:0:24942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331c400, rc 0) 00000100:00100000:1.0:1784405095.825353:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+15:18730:x1871083707986048:12345-192.168.202.42@tcp:101:bash.0 Request processed in 11441us (11654us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1784405095.825363:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 37 00000100:00100000:2.0:1784405095.846345:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405095.846493:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707986304 00000100:00100000:0.0:1784405095.846504:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707986304 00000100:00100000:0.0:1784405095.846630:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 38 00000100:00100000:0.0:1784405095.846644:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+15:18730:x1871083707986304:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:0.0:1784405095.846671:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405095.846693:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208c00/0x24b3e2e6dcd7ae27 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7888 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.846768:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209600/0x24b3e2e6dcd7ae2e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.846781:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209600/0x24b3e2e6dcd7ae2e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.846793:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209600/0x24b3e2e6dcd7ae2e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784405095.846898:0:22718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1784405095.846903:0:22718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784405095.846927:0:22718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209600/0x24b3e2e6dcd7ae2e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.846939:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209600/0x24b3e2e6dcd7ae2e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.846963:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208c00/0x24b3e2e6dcd7ae27 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7888 expref: 17 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.847002:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209600/0x24b3e2e6dcd7ae2e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7888 expref: 16 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405095.847011:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:0.0:1784405095.847014:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784405095.847018:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd56d209600, rc 0) 00000100:00100000:0.0:1784405095.847084:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+16:18730:x1871083707986304:12345-192.168.202.42@tcp:101:bash.0 Request processed in 443us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405095.847092:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 38 00000100:00100000:3.0:1784405095.850226:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405095.850647:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707986560 00000100:00100000:1.0:1784405095.850664:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707986560 00000100:00100000:1.0:1784405095.850739:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:1.0:1784405095.850752:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+16:18730:x1871083707986560:12345-192.168.202.42@tcp:35:bash.0 00000100:00100000:1.0:1784405095.851172:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+17:18730:x1871083707986560:12345-192.168.202.42@tcp:35:bash.0 Request processed in 421us (958us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1784405095.851190:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 5 00000100:00100000:1.0:1784405095.932959:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405095.933272:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707986816 00000100:00100000:2.0:1784405095.933283:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707986816 00000100:00100000:2.0:1784405095.933375:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:2.0:1784405095.933387:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+17:18740:x1871083707986816:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1784405095.933415:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784405095.933450:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7ae35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed788f expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784405095.933716:0:22717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784405095.933832:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7ae35 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed788f expref: 19 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.933848:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54a6b8900) 00010000:00010000:2.0:1784405095.934283:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784405095.934291:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7ae35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed788f expref: 19 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405095.934307:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442057800, rc 0) 00000100:00100000:3.0:1784405095.935029:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+18:18740:x1871083707986816:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 1640us (2073us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1784405095.935039:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 39 00000100:00100000:2.0:1784405095.938075:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405095.938165:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707987072 00000100:00100000:1.0:1784405095.938190:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707987072 00000100:00100000:1.0:1784405095.938252:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:1.0:1784405095.938271:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+18:18740:x1871083707987072:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:1.0:1784405095.938563:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+19:18740:x1871083707987072:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 301us (499us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1784405095.938573:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 6 00000100:00100000:2.0:1784405095.976676:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405095.976769:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707987328 00000100:00100000:3.0:1784405095.976781:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707987328 00000100:00100000:3.0:1784405095.977105:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:3.0:1784405095.977118:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+19:18743:x1871083707987328:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:3.0:1784405095.977144:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784405095.977166:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7ae43 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7896 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.977291:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7ae4a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.977308:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7ae4a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.977321:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7ae4a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784405095.977332:0:22719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784405095.977451:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7ae43 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7896 expref: 22 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.977473:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7ae4a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7896 expref: 21 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.977499:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:3.0:1784405095.977502:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784405095.977506:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b200, rc 0) 00000100:00100000:3.0:1784405095.977561:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+21:18743:x1871083707987328:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 446us (897us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1784405095.977568:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 40 00000100:00100000:2.0:1784405095.981787:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405095.981945:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707987456 00000100:00100000:1.0:1784405095.981957:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707987456 00000100:00100000:1.0:1784405095.982021:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 41 00000100:00100000:1.0:1784405095.982033:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+21:18743:x1871083707987456:12345-192.168.202.42@tcp:54:lfs.0 00010000:00010000:1.0:1784405095.982133:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae58 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.982151:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.982163:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.982210:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.982217:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae58 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.982223:0:24942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae58 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.982230:0:24942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331d200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784405095.982234:0:24942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae58 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.982242:0:24942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae58 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.982254:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:1.0:1784405095.982257:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784405095.982262:0:24942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae58 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405095.982270:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae58 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405095.982354:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+21:18743:x1871083707987456:12345-192.168.202.42@tcp:54:lfs.0 Request processed in 323us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405095.982362:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 41 00000100:00100000:2.0:1784405095.983508:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405095.983570:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707987584 00000100:00100000:3.0:1784405095.983579:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707987584 00000100:00100000:3.0:1784405095.983633:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:3.0:1784405095.983642:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+21:2404:x1871083707987584:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784405095.983656:0:22704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784405095.983678:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7ae4a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7896 expref: 21 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405095.983693:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:3.0:1784405095.983698:0:22704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784405095.983741:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+20:2404:x1871083707987584:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 99us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405095.983748:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 0 00000100:00100000:0.0:1784405095.990612:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405095.990689:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707987840 00000100:00100000:1.0:1784405095.990700:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707987840 00000100:00100000:1.0:1784405095.990763:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:1.0:1784405095.990774:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+20:18743:x1871083707987840:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:1.0:1784405095.991083:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+21:18743:x1871083707987840:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 302us (470us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1784405095.991092:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 7 00000100:00100000:2.0:1784405096.276790:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405096.276894:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707988096 00000100:00100000:3.0:1784405096.276906:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707988096 00000100:00100000:3.0:1784405096.276969:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00100000:3.0:1784405096.276979:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+21:18774:x1871083707988096:12345-192.168.202.42@tcp:101:cat.0 00010000:00010000:3.0:1784405096.277009:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784405096.277033:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7ae5f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed789d expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.277183:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7ae66 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.277198:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7ae66 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.277212:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7ae66 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784405096.277224:0:22719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784405096.277352:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7ae5f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed789d expref: 24 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.277373:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7ae66 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed789d expref: 23 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.277382:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:3.0:1784405096.277385:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784405096.277388:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a800, rc 0) 00000100:00100000:3.0:1784405096.277456:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+23:18774:x1871083707988096:12345-192.168.202.42@tcp:101:cat.0 Request processed in 478us (677us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1784405096.277463:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 42 00000100:00100000:0.0:1784405096.282266:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405096.284386:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707988352 00000100:00100000:3.0:1784405096.284402:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707988352 00000100:00100000:3.0:1784405096.284480:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:3.0:1784405096.284491:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+23:2403:x1871083707988352:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784405096.284506:0:22702:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784405096.284545:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7ae66 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed789d expref: 23 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.284565:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:3.0:1784405096.284571:0:22702:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784405096.284726:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+22:2403:x1871083707988352:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 237us (2473us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405096.284734:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 1 00000100:00100000:2.0:1784405096.284913:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405096.288675:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707988480 00000100:00100000:1.0:1784405096.288690:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707988480 00000100:00100000:1.0:1784405096.288771:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:1.0:1784405096.288791:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+22:18774:x1871083707988480:12345-192.168.202.42@tcp:35:cat.0 00000100:00100000:1.0:1784405096.289976:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+23:18774:x1871083707988480:12345-192.168.202.42@tcp:35:cat.0 Request processed in 1190us (5057us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1784405096.289989:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 8 00000100:00100000:0.0:1784405096.389043:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405096.389295:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707988736 00000100:00100000:1.0:1784405096.389305:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707988736 00000100:00100000:1.0:1784405096.389372:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 43 00000100:00100000:1.0:1784405096.389383:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+23:18780:x1871083707988736:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:1.0:1784405096.389410:0:24942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784405096.389432:0:24942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae74 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed78a4 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405096.389584:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ae7b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405096.389601:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ae7b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405096.389613:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ae7b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784405096.389625:0:24942:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784405096.389770:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7ae74 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78a4 expref: 26 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405096.389791:0:24942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ae7b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78a4 expref: 25 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405096.389801:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:1.0:1784405096.389804:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784405096.389807:0:24942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331c200, rc 0) 00000100:00100000:0.0:1784405096.391260:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+25:18780:x1871083707988736:12345-192.168.202.42@tcp:101:dd.0 Request processed in 1869us (2217us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1784405096.391271:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 43 00000100:00100000:0.0:1784405096.395922:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405096.395965:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405096.396013:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707988992 00000100:00100000:3.0:1784405096.396024:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707988992 00000100:00100000:1.0:1784405096.396205:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707988864 00000100:00100000:1.0:1784405096.396209:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707988864 00000100:00100000:1.0:1784405096.396261:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 2 00000100:00100000:1.0:1784405096.396272:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+26:2402:x1871083707988864:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784405096.396292:0:22703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784405096.396319:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c200/0x24b3e2e6dcd7ae7b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78a4 expref: 26 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405096.396340:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:3.0:1784405096.396348:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+26:18780:x1871083707988992:12345-192.168.202.42@tcp:101:dd.0 00010000:00010000:1.0:1784405096.396357:0:22703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:1.0:1784405096.396363:0:22703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784405096.396370:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784405096.396385:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7ae89 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed78ab expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.396414:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7ae90 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405096.396416:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+26:2402:x1871083707988864:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 146us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405096.396424:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 2 00010000:00010000:3.0:1784405096.396428:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7ae90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.396438:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7ae90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.396565:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7ae89 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78ab expref: 26 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.396579:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7ae90 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78ab expref: 25 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.396592:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:3.0:1784405096.396595:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784405096.396597:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151b200, rc 0) 00000100:00100000:3.0:1784405096.396631:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+25:18780:x1871083707988992:12345-192.168.202.42@tcp:101:dd.0 Request processed in 283us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405096.396637:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 44 00000100:00100000:0.0:1784405096.403768:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405096.403948:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707989248 00000100:00100000:3.0:1784405096.403960:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707989248 00000100:00100000:3.0:1784405096.404012:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 45 00000100:00100000:3.0:1784405096.404023:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+25:18780:x1871083707989248:12345-192.168.202.42@tcp:36:dd.0 00010000:00010000:3.0:1784405096.404951:0:22717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784405096.404983:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209600/0x24b3e2e6dcd7ae2e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7888 expref: 25 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.405006:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:3.0:1784405096.405012:0:22717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784405096.405988:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd7ae97 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.406008:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd7ae97 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.406021:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd7ae97 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784405096.406944:0:22717:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1784405096.406994:0:22717:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000005a78af6 reply state 000000001a1f5774 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd7ae97 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.407025:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd7ae97 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.407033:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:3.0:1784405096.407036:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784405096.407040:0:22717:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784405096.407595:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+27:18780:x1871083707989248:12345-192.168.202.42@tcp:36:dd.0 Request processed in 3570us (3836us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1784405096.407604:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 45 00000020:00080000:3.0:1784405096.407612:0:22717:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784405096.451252:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784405096.485136:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405096.493933:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707989504 00000100:00100000:3.0:1784405096.493949:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707989504 00000100:00100000:3.0:1784405096.494097:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:3.0:1784405096.494109:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+27:18780:x1871083707989504:12345-192.168.202.42@tcp:35:dd.0 00000100:00100000:3.0:1784405096.494365:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+28:18780:x1871083707989504:12345-192.168.202.42@tcp:35:dd.0 Request processed in 257us (9636us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1784405096.494374:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 9 00000100:00100000:1.0:1784405096.707143:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405096.707324:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707989632 00000100:00100000:2.0:1784405096.707334:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707989632 00000100:00100000:2.0:1784405096.708515:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:2.0:1784405096.708538:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+28:18794:x1871083707989632:12345-192.168.202.42@tcp:101:stat.0 00010000:00010000:2.0:1784405096.708568:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784405096.708613:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7ae9e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed78b2 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.708694:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7aea5 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.708713:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7aea5 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.708726:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7aea5 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.708738:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7aeac lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.708745:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7aeac lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.708751:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7aeac lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.708836:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7aeb3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.708844:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7aeb3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.708870:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7aeb3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784405096.708923:0:22718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784405096.708928:0:22718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784405096.708971:0:22718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7aeb3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.708991:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7aeb3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.709000:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7aea5 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.709008:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7aea5 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.709014:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7aea5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.709020:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784405096.709025:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7aea5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.709033:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7aea5 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.709047:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd54a6b8d00) 00010000:00010000:2.0:1784405096.709050:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784405096.709055:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7aea5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.709062:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7aea5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.709077:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7aeac lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.709083:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7aeac lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.709096:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7aeac lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.709102:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057e00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784405096.709105:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7aeac lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.709111:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7aeac lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.709120:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9dd54a6b8500) 00010000:00010000:2.0:1784405096.709122:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784405096.709125:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7aeac lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.709131:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7aeac lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.709160:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7ae9e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78b2 expref: 30 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.709188:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7aeb3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78b2 expref: 29 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.709196:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:2.0:1784405096.709198:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784405096.709201:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442056400, rc 0) 00000100:00100000:2.0:1784405096.709277:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+29:18794:x1871083707989632:12345-192.168.202.42@tcp:101:stat.0 Request processed in 749us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405096.709294:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 46 00000100:00100000:0.0:1784405096.777150:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405096.777275:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707989888 00000100:00100000:2.0:1784405096.777286:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707989888 00000100:00100000:2.0:1784405096.777348:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 47 00000100:00100000:2.0:1784405096.777359:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+29:18800:x1871083707989888:12345-192.168.202.42@tcp:36:truncate.0 00010000:00010000:2.0:1784405096.777415:0:24942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784405096.777444:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7aeb3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78b2 expref: 29 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.777465:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:2.0:1784405096.777469:0:24942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784405096.777638:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7aeba lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.777652:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7aeba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.777662:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7aeba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784405096.777705:0:24942:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:2.0:1784405096.777728:0:24942:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000089329ae0 reply state 00000000e5fc1521 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7aeba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.777740:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7aeba lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405096.777747:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:2.0:1784405096.777749:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784405096.777765:0:24942:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784405096.778034:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+31:18800:x1871083707989888:12345-192.168.202.42@tcp:36:truncate.0 Request processed in 676us (894us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1784405096.778042:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 47 00000020:00080000:2.0:1784405096.778047:0:24942:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784405096.835468:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784405096.835492:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729060736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784405096.835574:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405096.835629:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729060736 00000100:00100000:2.0:1784405096.835639:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729060736 00000100:00100000:2.0:1784405096.835698:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784405096.835708:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729060736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784405096.835739:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1784405096.835798:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1871083729060736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405096.835805:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784405096.835889:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1871083729060736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784405096.937481:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405096.937641:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707990016 00000100:00100000:3.0:1784405096.937651:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707990016 00000100:00100000:3.0:1784405096.937713:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 48 00000100:00100000:3.0:1784405096.937723:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+31:18814:x1871083707990016:12345-192.168.202.42@tcp:101:stat.0 00010000:00010000:3.0:1784405096.937746:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784405096.937767:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7aec1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed78b9 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.937835:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7aec8 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938154:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7aec8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938182:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7aec8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938197:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aecf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938204:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aecf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938211:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aecf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938286:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7aed6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938294:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7aed6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938300:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7aed6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784405096.938346:0:22719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1784405096.938351:0:22719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784405096.938377:0:22719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7aed6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938393:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7aed6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938412:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7aec8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938419:0:22719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7aec8 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938425:0:22719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7aec8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938431:0:22719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784405096.938436:0:22719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7aec8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938443:0:22719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7aec8 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938455:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd54a6b8d00) 00010000:00010000:3.0:1784405096.938458:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784405096.938463:0:22719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7aec8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938468:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7aec8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938484:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aecf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938490:0:22719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aecf lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938496:0:22719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aecf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938508:0:22719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151ba00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784405096.938511:0:22719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aecf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938516:0:22719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aecf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938525:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9dd54a6b8500) 00010000:00010000:3.0:1784405096.938527:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784405096.938531:0:22719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aecf lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938537:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aecf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938568:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7aec1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78b9 expref: 33 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938583:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7aed6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78b9 expref: 32 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405096.938589:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:3.0:1784405096.938592:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784405096.938594:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151bc00, rc 0) 00000100:00100000:3.0:1784405096.938676:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+32:18814:x1871083707990016:12345-192.168.202.42@tcp:101:stat.0 Request processed in 954us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405096.938684:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 48 00000100:00100000:0.0:1784405097.041200:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405097.041521:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707990272 00000100:00100000:2.0:1784405097.041532:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707990272 00000100:00100000:2.0:1784405097.041616:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 49 00000100:00100000:2.0:1784405097.041628:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+32:18824:x1871083707990272:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1784405097.041649:0:24942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784405097.041671:0:24942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7aedd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed78c0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784405097.041770:0:24942:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784405097.042013:0:24942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7aedd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78c0 expref: 34 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.042027:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54a6b8900) 00010000:00010000:2.0:1784405097.042030:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784405097.042050:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7aedd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78c0 expref: 34 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.042074:0:24942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442056400, rc 0) 00000100:00100000:2.0:1784405097.042145:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+33:18824:x1871083707990272:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 519us (989us total) trans 12884901910 rc 301/301 00000100:00100000:2.0:1784405097.042153:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 49 00000100:00080000:0.0:1784405097.042342:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784405097.047516:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405097.047696:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707990528 00000100:00100000:1.0:1784405097.047707:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707990528 00000100:00100000:1.0:1784405097.047768:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:1.0:1784405097.047780:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570651c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+33:18824:x1871083707990528:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:1.0:1784405097.048937:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570651c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+34:18824:x1871083707990528:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 1154us (1424us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1784405097.048948:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 10 00000100:00100000:1.0:1784405097.132399:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405097.132453:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707990784 00000100:00100000:3.0:1784405097.132478:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707990784 00000100:00100000:3.0:1784405097.132549:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 50 00000100:00100000:3.0:1784405097.132740:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+34:18830:x1871083707990784:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1784405097.132768:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784405097.132791:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7aeeb lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed78c7 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.133365:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aef2 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.133381:0:22719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c400/0x24b3e2e6dcd7ae19 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7881 expref: 35 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.133390:0:22719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7aed6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78b9 expref: 35 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.133398:0:22719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aef2 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.133436:0:22719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7aed6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78b9 expref: 35 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.133451:0:22719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7aed6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78b9 expref: 35 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405097.133465:0:22719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541665c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22719:1871083729060864:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784405097.133808:0:22719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c400/0x24b3e2e6dcd7ae19 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7881 expref: 35 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.134093:0:22719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c400/0x24b3e2e6dcd7ae19 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7881 expref: 35 pid: 24942 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405097.134104:0:22719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22719:1871083729060992:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784405097.134138:0:22719:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443c13600 going to sleep for 11 seconds 00000100:00100000:3.0:1784405097.142371:0:22719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541665c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22719:1871083729060864:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784405097.142388:0:22719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541666300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22719:1871083729060992:192.168.202.42@tcp:104: 00010000:00010000:3.0:1784405097.142416:0:22719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aef2 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405097.146214:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405097.146254:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405097.146407:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707990912 00000100:00100000:3.0:1784405097.146421:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707990912 00010000:00010000:3.0:1784405097.146471:0:22702:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7aed6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78b9 expref: 36 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405097.146517:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707991040 00000100:00100000:3.0:1784405097.146521:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707991040 00010000:00010000:3.0:1784405097.146534:0:22702:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c400/0x24b3e2e6dcd7ae19 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7881 expref: 37 pid: 24942 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405097.146551:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:3.0:1784405097.146560:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57cedd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+37:2404:x1871083707990912:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784405097.146575:0:22702:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784405097.146583:0:22702:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7aed6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78b9 expref: 37 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.146617:0:22702:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7aed6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78b9 expref: 37 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.146642:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7aed6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78b9 expref: 37 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.146662:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:3.0:1784405097.146668:0:22702:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aef2 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.146678:0:22702:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aef2 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.146686:0:22702:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784405097.146765:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57cedd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+36:2404:x1871083707990912:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 205us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405097.146773:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 17 00000100:00100000:3.0:1784405097.146822:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 18 00000100:00100000:3.0:1784405097.146829:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+35:2403:x1871083707991040:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784405097.146836:0:22702:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784405097.146841:0:22702:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c400/0x24b3e2e6dcd7ae19 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7881 expref: 35 pid: 24942 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.147672:0:22702:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c400/0x24b3e2e6dcd7ae19 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7881 expref: 35 pid: 24942 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.147716:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c400/0x24b3e2e6dcd7ae19 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7881 expref: 35 pid: 24942 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.147730:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:3.0:1784405097.147734:0:22702:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aef2 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.147743:0:22702:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aef2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.147752:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aef2 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.147827:0:22702:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784405097.148071:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+34:2403:x1871083707991040:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 1239us (1813us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405097.148081:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 18 00010000:00010000:2.0:1784405097.150276:0:22719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aef2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.150292:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aef2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784405097.150318:0:22719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1784405097.150484:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a800/0x24b3e2e6dcd7aeeb lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78c7 expref: 35 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.150507:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aef2 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78c7 expref: 34 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.150517:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:2.0:1784405097.150520:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784405097.150523:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151ba00, rc 0) 00000100:00100000:2.0:1784405097.150604:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+34:18830:x1871083707990784:12345-192.168.202.42@tcp:101:bash.0 Request processed in 17859us (18204us total) trans 12884901912 rc 0/0 00000100:00100000:2.0:1784405097.150614:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 50 00000100:00100000:2.0:1784405097.165246:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405097.165512:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707991296 00000100:00100000:3.0:1784405097.165522:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707991296 00000100:00100000:3.0:1784405097.165622:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 51 00000100:00100000:3.0:1784405097.165633:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+34:18830:x1871083707991296:12345-192.168.202.42@tcp:36:bash.0 00010000:00010000:3.0:1784405097.166050:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7af00 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.166139:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7af00 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.166152:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7af00 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784405097.166231:0:24942:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:3.0:1784405097.166254:0:24942:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cf996b08 reply state 000000006369f4d5 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7af00 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.166266:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7af00 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.166274:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:3.0:1784405097.166277:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784405097.166280:0:24942:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784405097.166458:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+37:18830:x1871083707991296:12345-192.168.202.42@tcp:36:bash.0 Request processed in 826us (1220us total) trans 12884901914 rc 0/0 00000100:00100000:3.0:1784405097.166467:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 51 00000020:00080000:3.0:1784405097.166472:0:24942:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784405097.168891:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405097.169053:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707991424 00000100:00100000:0.0:1784405097.169115:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707991424 00000100:00100000:2.0:1784405097.169209:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:2.0:1784405097.169221:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+37:18830:x1871083707991424:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:2.0:1784405097.169258:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784405097.169274:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7af07 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed78ce expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.169329:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7af07 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78ce expref: 38 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.169344:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7af07 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78ce expref: 38 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.169421:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:2.0:1784405097.169423:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784405097.169426:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442057800, rc 0) 00000100:00100000:2.0:1784405097.169477:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+38:18830:x1871083707991424:12345-192.168.202.42@tcp:101:bash.0 Request processed in 259us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405097.169484:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 52 00000100:00100000:0.0:1784405097.173613:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405097.173680:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707991552 00000100:00100000:1.0:1784405097.173690:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707991552 00000100:00100000:1.0:1784405097.173758:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:1.0:1784405097.173768:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+38:18830:x1871083707991552:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1784405097.173787:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784405097.173809:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7af0e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed78d5 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.174107:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af15 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.174123:0:22717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aef2 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78c7 expref: 39 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.174132:0:22717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af15 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.174160:0:22717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aef2 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78c7 expref: 39 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.174187:0:22717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aef2 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78c7 expref: 39 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405097.174202:0:22717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd5445e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22717:1871083729061120:192.168.202.42@tcp:104: 00000100:00100000:1.0:1784405097.174297:0:22717:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd543d78300 going to sleep for 11 seconds 00000100:00100000:0.0:1784405097.177288:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405097.177474:0:22717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd5445e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22717:1871083729061120:192.168.202.42@tcp:104: 00010000:00010000:1.0:1784405097.177501:0:22717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af15 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405097.177576:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707991680 00000100:00100000:2.0:1784405097.177585:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707991680 00010000:00010000:2.0:1784405097.177625:0:22704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aef2 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78c7 expref: 40 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405097.177705:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 19 00000100:00100000:2.0:1784405097.177715:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541324e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+40:2403:x1871083707991680:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784405097.177730:0:22704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784405097.177737:0:22704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aef2 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78c7 expref: 40 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.177784:0:22704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aef2 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78c7 expref: 40 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.177807:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ba00/0x24b3e2e6dcd7aef2 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78c7 expref: 40 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.177825:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:2.0:1784405097.177830:0:22704:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af15 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.177897:0:22704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af15 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.177906:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af15 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.178046:0:22704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784405097.178108:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541324e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+39:2403:x1871083707991680:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 394us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405097.178116:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 19 00010000:00010000:1.0:1784405097.179151:0:22717:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af15 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.179184:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af15 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784405097.179235:0:22717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1784405097.179240:0:22717:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784405097.179259:0:22717:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af15 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.179290:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7af0e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78d5 expref: 39 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.179308:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af15 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78d5 expref: 38 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.179316:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:1.0:1784405097.179318:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784405097.179321:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331c000, rc 0) 00000100:00100000:1.0:1784405097.179388:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+38:18830:x1871083707991552:12345-192.168.202.42@tcp:101:bash.0 Request processed in 5620us (5782us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405097.179396:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 53 00000100:00100000:0.0:1784405097.182722:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405097.182899:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707991936 00000100:00100000:1.0:1784405097.182981:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707991936 00000100:00100000:1.0:1784405097.183051:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:1.0:1784405097.183175:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+38:18830:x1871083707991936:12345-192.168.202.42@tcp:103:bash.0 00010000:00010000:1.0:1784405097.183195:0:22703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784405097.183222:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7af07 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78ce expref: 38 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.183266:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af15 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78d5 expref: 37 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.183279:0:22703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:1.0:1784405097.183283:0:22703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784405097.183389:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+36:18830:x1871083707991936:12345-192.168.202.42@tcp:103:bash.0 Request processed in 329us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405097.183398:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 3 00000100:00100000:0.0:1784405097.186611:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405097.186710:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707992064 00000100:00100000:2.0:1784405097.186722:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707992064 00000100:00100000:2.0:1784405097.186784:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:2.0:1784405097.186795:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+36:18830:x1871083707992064:12345-192.168.202.42@tcp:58:bash.0 00010000:00010000:2.0:1784405097.187273:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7af1c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.187292:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7af1c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.187318:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7af1c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784405097.189194:0:22718:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784405097.189228:0:22718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1784405097.189348:0:22718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1784405097.189586:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+36:18830:x1871083707992064:12345-192.168.202.42@tcp:58:bash.0 Request processed in 2787us (2980us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405097.189597:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 54 00000100:00100000:0.0:1784405097.192904:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405097.193143:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707992192 00000100:00100000:3.0:1784405097.193154:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707992192 00000100:00100000:3.0:1784405097.193227:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 55 00000100:00100000:3.0:1784405097.193238:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+36:18830:x1871083707992192:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:3.0:1784405097.193260:0:24942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784405097.193282:0:24942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7af23 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed78dc expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.193339:0:24942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7af1c lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.193361:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7af23 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78dc expref: 37 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.193406:0:24942:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7af1c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.193422:0:24942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7af23 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78dc expref: 37 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.193436:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:3.0:1784405097.193440:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784405097.193444:0:24942:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7af23 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78dc expref: 37 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.193452:0:24942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd58151a000, rc 0) 00000100:00100000:3.0:1784405097.193512:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+37:18830:x1871083707992192:12345-192.168.202.42@tcp:101:bash.0 Request processed in 276us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405097.193519:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 55 00010000:00010000:1.0:1784405097.477918:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784405097.679340:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405097.679411:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707992320 00000100:00100000:2.0:1784405097.679421:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707992320 00000100:00100000:2.0:1784405097.679483:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 166 00000100:00100000:2.0:1784405097.679494:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:2402:x1871083707992320:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784405097.679575:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fdbdd43e-6bbb-45ce-a40c-f55b1c6437e3+13:2402:x1871083707992320:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 82us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405097.679584:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 166 00000100:00100000:0.0:1784405097.690969:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405097.691003:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405097.691031:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405097.691054:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405097.691082:0:24642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707992704 00000100:00100000:0.0:1784405097.691091:0:24642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707992704 00000100:00100000:2.0:1784405097.691136:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707992448 00000100:00100000:2.0:1784405097.691142:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707992448 00000100:00100000:0.0:1784405097.691171:0:24642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707993216 00000100:00100000:0.0:1784405097.691176:0:24642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707993216 00000100:00100000:2.0:1784405097.691182:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:2.0:1784405097.691195:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:2401:x1871083707992704:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784405097.691205:0:24642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:0.0:1784405097.691215:0:24642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2007b688-b060-4b6f-9f62-4b541c93b597+5:2401:x1871083707993216:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:2.0:1784405097.691276:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:2401:x1871083707992704:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 84us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405097.691284:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00080000:1.0:1784405097.691317:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784405097.691322:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784405097.691337:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707992960 00000100:00100000:2.0:1784405097.691340:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707992960 00000100:00100000:2.0:1784405097.691375:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:3.0:1784405097.691398:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:2.0:1784405097.691400:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:2401:x1871083707992448:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:3.0:1784405097.691429:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2007b688-b060-4b6f-9f62-4b541c93b597+5:2401:x1871083707992960:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784405097.691687:0:24642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2007b688-b060-4b6f-9f62-4b541c93b597+5:2401:x1871083707993216:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 473us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405097.691694:0:24642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00080000:0.0:1784405097.691817:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784405097.692818:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405097.692883:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405097.693072:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405097.693101:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707992576 00000100:00100000:1.0:1784405097.693109:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707992576 00000100:00100000:1.0:1784405097.693155:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707993088 00000100:00100000:1.0:1784405097.693169:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707993088 00000100:00100000:1.0:1784405097.693193:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:1.0:1784405097.693201:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:2401:x1871083707992576:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784405097.693264:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:2401:x1871083707992576:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 62us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405097.693273:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:1.0:1784405097.693291:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:1.0:1784405097.693596:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2007b688-b060-4b6f-9f62-4b541c93b597+5:2401:x1871083707993088:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:1.0:1784405097.693641:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2007b688-b060-4b6f-9f62-4b541c93b597+5:2401:x1871083707993088:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 344us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405097.693648:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00080000:1.0:1784405097.693670:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784405097.693684:0:22717:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1784405097.693701:0:22717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1784405097.694429:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707992832 00000100:00100000:0.0:1784405097.694437:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707992832 00000100:00100000:0.0:1784405097.694620:0:22717:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1784405097.694632:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 62 00000100:00100000:0.0:1784405097.694642:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2007b688-b060-4b6f-9f62-4b541c93b597+12:2401:x1871083707992832:12345-192.168.202.42@tcp:400:kworker.0 00000100:00100000:0.0:1784405097.694698:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2007b688-b060-4b6f-9f62-4b541c93b597+12:2401:x1871083707992832:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 57us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405097.694704:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 62 00000100:00100000:2.0:1784405097.694924:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:2401:x1871083707992448:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 3525us (3962us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405097.694932:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00080000:2.0:1784405097.694965:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784405097.697373:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2007b688-b060-4b6f-9f62-4b541c93b597+5:2401:x1871083707992960:12345-192.168.202.42@tcp:400:kworker.0 Request processed in 5952us (6327us total) trans 0 rc 0/0 00000100:00100000:3.0:1784405097.697389:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 61 00000040:00080000:0.0:1784405097.795190:0:22751:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1784405097.795201:0:22751:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784405097.795230:0:22751:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1784405097.795240:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1784405097.795403:0:22751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541327b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22751:1871083729061248:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784405097.795509:0:22751:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd552680900 going to sleep for 11 seconds 00000100:00100000:3.0:1784405097.805100:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405097.805284:0:22751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541327b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22751:1871083729061248:192.168.202.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784405097.807961:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707993344 00000100:00100000:1.0:1784405097.807976:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707993344 00000100:00100000:1.0:1784405097.808055:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 56 00000100:00100000:1.0:1784405097.808066:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+37:18831:x1871083707993344:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784405097.808099:0:22717:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784405097.808268:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+37:18831:x1871083707993344:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 204us (3179us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405097.808277:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 56 00000100:00100000:1.0:1784405097.812211:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405097.820313:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707993472 00000100:00100000:2.0:1784405097.820332:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707993472 00000100:00100000:2.0:1784405097.820411:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:2.0:1784405097.820422:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+37:18831:x1871083707993472:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784405097.820560:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af2a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820579:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820590:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820643:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7af31 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820652:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7af31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820658:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7af31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820690:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7af38 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820719:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7af38 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820726:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7af38 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784405097.820780:0:22718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784405097.820785:0:22718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784405097.820802:0:22718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7af38 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820812:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820819:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af2a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820825:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af2a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820831:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784405097.820834:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af2a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820841:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af2a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820876:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd57067d600) 00010000:00010000:2.0:1784405097.820880:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784405097.820885:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af2a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820902:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af2a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820917:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7af31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820924:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7af31 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820929:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7af31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820933:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784405097.820936:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7af31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820942:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7af31 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820951:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9dd443416a00) 00010000:00010000:2.0:1784405097.820953:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784405097.820956:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7af31 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820961:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7af31 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820977:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7af38 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820983:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7af38 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820993:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7af38 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.820998:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057e00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784405097.821000:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7af38 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.821006:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7af38 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.821013:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:2.0:1784405097.821015:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784405097.821017:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7af38 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.821035:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7af38 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405097.821126:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+37:18831:x1871083707993472:12345-192.168.202.42@tcp:34:lhsmtool_posix.0 Request processed in 704us (8926us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405097.821135:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 57 00000100:00100000:3.0:1784405097.824747:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405097.825068:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707993728 00000100:00100000:1.0:1784405097.825079:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707993728 00000100:00100000:1.0:1784405097.825152:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:1.0:1784405097.825173:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+37:18831:x1871083707993728:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784405097.825194:0:24942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784405097.825216:0:24942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7af3f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed78e3 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.825326:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af46 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.825343:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af46 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.825370:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af46 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784405097.825383:0:24942:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784405097.825463:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af46 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.825471:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af46 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.825478:0:24942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af46 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.825483:0:24942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331c000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:1.0:1784405097.825487:0:24942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af46 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.825495:0:24942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af46 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.825507:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:1.0:1784405097.825509:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784405097.825514:0:24942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af46 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.825520:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7af46 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.825562:0:24942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7af3f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78e3 expref: 39 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.825595:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dd57067d600) 00010000:00010000:1.0:1784405097.825598:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784405097.825603:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7af3f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78e3 expref: 39 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.825614:0:24942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331d200, rc 0) 00000100:00100000:1.0:1784405097.825688:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+38:18831:x1871083707993728:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 517us (951us total) trans 12884901915 rc 301/301 00000100:00100000:1.0:1784405097.825697:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 58 00000100:00100000:3.0:1784405097.833043:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405097.833436:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707993856 00000100:00100000:0.0:1784405097.833518:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707993856 00000100:00100000:0.0:1784405097.833593:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:0.0:1784405097.833603:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd574d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+38:18831:x1871083707993856:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784405097.833643:0:22719:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784405097.834946:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd574d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+38:18831:x1871083707993856:12345-192.168.202.42@tcp:53:lhsmtool_posix.0 Request processed in 1338us (1909us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405097.834958:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 59 00000100:00100000:3.0:1784405097.842137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405097.843942:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707994112 00000100:00100000:2.0:1784405097.843955:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707994112 00000100:00100000:2.0:1784405097.844046:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:2.0:1784405097.844057:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+38:18831:x1871083707994112:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784405097.844078:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784405097.844099:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7af54 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed78ea expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784405097.844558:0:22718:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:2.0:1784405097.844565:0:22718:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:2.0:1784405097.844580:0:22718:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:2.0:1784405097.844730:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7af5b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.844743:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7af5b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.844754:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7af5b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.844812:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057e00/0x24b3e2e6dcd7af54 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78ea expref: 41 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.844831:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7af5b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78ea expref: 40 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.844839:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:2.0:1784405097.844842:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784405097.844846:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd442057800, rc 0) 00000100:00100000:2.0:1784405097.844980:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+40:18831:x1871083707994112:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 924us (2853us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1784405097.844989:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 60 00000100:00100000:3.0:1784405097.851188:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405097.851456:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707994368 00000100:00100000:2.0:1784405097.851470:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707994368 00000100:00100000:2.0:1784405097.851531:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:2.0:1784405097.851542:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+40:18831:x1871083707994368:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784405097.851643:0:22717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784405097.851682:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057800/0x24b3e2e6dcd7af5b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78ea expref: 40 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.851710:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd443416a00) 00010000:00010000:2.0:1784405097.851722:0:22717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784405097.851753:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af69 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.851777:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af69 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.851794:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af69 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.851811:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af70 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3fdad71e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.851818:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af70 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3fdad71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.851824:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af70 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3fdad71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.851916:0:22717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af69 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.851923:0:22717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af69 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.851929:0:22717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af69 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.851940:0:22717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784405097.851945:0:22717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af69 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.851952:0:22717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af69 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.851961:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd54a6b8d00) 00010000:00010000:2.0:1784405097.851964:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784405097.851967:0:22717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af69 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.851974:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056600/0x24b3e2e6dcd7af69 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.851992:0:22717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af70 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3fdad71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.851999:0:22717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af70 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3fdad71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.852005:0:22717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af70 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3fdad71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.852009:0:22717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784405097.852019:0:22717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af70 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3fdad71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.852026:0:22717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af70 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3fdad71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.852044:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x3fdad71e (ffff9dd443416600) 00010000:00010000:2.0:1784405097.852054:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784405097.852057:0:22717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af70 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3fdad71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.852064:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af70 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3fdad71e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405097.852184:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+39:18831:x1871083707994368:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 643us (1006us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784405097.852192:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 61 00000100:00100000:3.0:1784405097.856196:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405097.857237:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707994496 00000100:00100000:0.0:1784405097.857251:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707994496 00000100:00100000:0.0:1784405097.857320:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 62 00000100:00100000:0.0:1784405097.857330:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+39:18831:x1871083707994496:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784405097.857351:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405097.857374:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209400/0x24b3e2e6dcd7af77 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed78f1 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405097.859083:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784405097.859113:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729061376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784405097.859218:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405097.859308:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729061376 00000100:00100000:2.0:1784405097.859318:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729061376 00000100:00100000:2.0:1784405097.859377:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784405097.859389:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083729061376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784405097.859427:0:22722:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784405097.859483:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1871083729061376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405097.859488:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784405097.859974:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729061376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784405097.860238:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd541327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729061504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784405097.860279:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405097.860364:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729061504 00000100:00100000:0.0:1784405097.860369:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729061504 00000100:00100000:0.0:1784405097.860434:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784405097.860443:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729061504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784405097.860490:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1784405097.860528:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729061504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405097.860535:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1784405097.861685:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784405097.861734:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd541327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729061504:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784405097.862277:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7af7e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.862297:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7af7e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.862310:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7af7e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.862466:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d209400/0x24b3e2e6dcd7af77 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78f1 expref: 41 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.862491:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d200/0x24b3e2e6dcd7af7e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78f1 expref: 40 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.862511:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd57067d000) 00010000:00010000:1.0:1784405097.862514:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784405097.862518:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331d200, rc 0) 00000100:00100000:1.0:1784405097.863179:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+40:18831:x1871083707994496:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 5846us (6989us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405097.863188:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 62 00000100:00100000:1.0:1784405097.863677:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784405097.863693:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729061632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784405097.863766:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405097.864215:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729061632 00000100:00100000:2.0:1784405097.864223:0:23457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729061632 00000100:00100000:2.0:1784405097.864272:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784405097.864281:0:23457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729061632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784405097.864310:0:23457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1784405097.864352:0:23457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729061632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405097.864357:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784405097.864443:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729061632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784405097.874202:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405097.874355:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707994752 00000100:00100000:3.0:1784405097.874368:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707994752 00000100:00100000:3.0:1784405097.874448:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:3.0:1784405097.874461:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+40:18831:x1871083707994752:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784405097.875170:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7af85 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.875192:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7af85 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.875205:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7af85 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784405097.875411:0:24942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:3.0:1784405097.875422:0:24942:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 715759569657ns, next at 716759567258ns, rc = 0 00000004:00010000:3.0:1784405097.875472:0:24942:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000716b81b8 reply state 00000000b16f1003 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7af85 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.875486:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7af85 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.875721:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd57067d000) 00010000:00010000:3.0:1784405097.875724:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1784405097.875729:0:24942:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784405097.876150:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+42:18831:x1871083707994752:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 1689us (1956us total) trans 12884901917 rc 0/0 00000100:00100000:3.0:1784405097.876167:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 63 00000100:00100000:0.0:1784405097.879274:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405097.879349:0:25762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707994880 00000100:00100000:2.0:1784405097.879359:0:25762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707994880 00000100:00100000:2.0:1784405097.879429:0:25762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 64 00000100:00100000:2.0:1784405097.879439:0:25762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+42:18831:x1871083707994880:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784405097.879613:0:25762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784405097.879636:0:25762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af8c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed78f8 expref: -99 pid: 25762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.879702:0:25762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af8c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78f8 expref: 43 pid: 25762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.879717:0:25762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af8c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78f8 expref: 43 pid: 25762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.879842:0:25762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd57067d000) 00010000:00010000:2.0:1784405097.879944:0:25762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784405097.879949:0:25762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548759800, rc 0) 00000100:00100000:0.0:1784405097.880138:0:25762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+43:18831:x1871083707994880:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 699us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405097.880144:0:25762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 64 00000100:00100000:0.0:1784405097.884656:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405097.884886:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707995008 00000100:00100000:1.0:1784405097.884897:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707995008 00000100:00100000:1.0:1784405097.884970:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:1.0:1784405097.884981:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+5:2403:x1871083707995008:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1784405097.885374:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:2403:x1871083707995008:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 394us (728us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1784405097.885383:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 24 00000100:00100000:1.0:1784405097.888168:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405097.888283:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707995264 00000100:00100000:3.0:1784405097.888293:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707995264 00000100:00100000:3.0:1784405097.889307:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:3.0:1784405097.889354:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+43:18831:x1871083707995264:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784405097.890139:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+44:18831:x1871083707995264:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 816us (1987us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1784405097.890148:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 11 00000100:00100000:0.0:1784405097.893196:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405097.893297:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707995520 00000100:00100000:1.0:1784405097.893307:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707995520 00000100:00100000:1.0:1784405097.893367:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 65 00000100:00100000:1.0:1784405097.893378:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+44:18831:x1871083707995520:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784405097.893714:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+44:18831:x1871083707995520:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 337us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405097.893722:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 65 00000100:00100000:2.0:1784405097.896074:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405097.896792:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707995648 00000100:00100000:3.0:1784405097.896803:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707995648 00000100:00100000:2.0:1784405097.897316:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00100000:2.0:1784405097.897331:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+44:18831:x1871083707995648:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784405097.897350:0:24942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784405097.897371:0:24942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759c00/0x24b3e2e6dcd7af93 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed78ff expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.897472:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd7af9a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.897489:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd7af9a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.897515:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd7af9a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784405097.897563:0:24942:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784405097.897582:0:24942:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd7af9a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.897608:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759c00/0x24b3e2e6dcd7af93 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78ff expref: 46 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.897626:0:24942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd7af9a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78ff expref: 45 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.897635:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd57067d000) 00010000:00010000:2.0:1784405097.897638:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784405097.897641:0:24942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758200, rc 0) 00000100:00100000:2.0:1784405097.897760:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+45:18831:x1871083707995648:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 429us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405097.897767:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 66 00000100:00100000:1.0:1784405097.904954:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405097.905332:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707995776 00000100:00100000:0.0:1784405097.905342:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707995776 00000100:00100000:0.0:1784405097.905410:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:0.0:1784405097.905421:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+6:2404:x1871083707995776:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784405097.905442:0:24222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784405097.905467:0:24222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000023cf689/0x24b3e2e6dcd7afa1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7906 expref: -99 pid: 24222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784405097.905504:0:24222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5bdc6a, blocks: 0x0 00010000:00010000:0.0:1784405097.905528:0:24222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=715s v=(0 0) 00010000:00010000:0.0:1784405097.905533:0:24222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784405097.905543:0:24222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000023cf689/0x24b3e2e6dcd7afa1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7906 expref: 7 pid: 24222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405097.905573:0:24222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000023cf689/0x24b3e2e6dcd7afa1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7906 expref: 7 pid: 24222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405097.905611:0:24222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd56d209400, rc 0) 00000100:00100000:0.0:1784405097.905679:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+7:2404:x1871083707995776:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 259us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405097.905686:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 25 00000100:00100000:3.0:1784405097.909758:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405097.910008:0:25762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707996032 00000100:00100000:0.0:1784405097.910021:0:25762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707996032 00000100:00100000:0.0:1784405097.910205:0:25762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00100000:0.0:1784405097.910217:0:25762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573f7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+45:18831:x1871083707996032:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784405097.910335:0:25762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573f7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+45:18831:x1871083707996032:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 120us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405097.910343:0:25762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 67 00000100:00100000:1.0:1784405097.917541:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405097.917766:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707996160 00000100:00100000:0.0:1784405097.917776:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707996160 00000100:00100000:0.0:1784405097.917906:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 68 00000100:00100000:0.0:1784405097.917918:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd570593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+45:18831:x1871083707996160:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1784405097.920562:0:22696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:1.0:1784405097.920581:0:22696:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1784405097.920661:0:22696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:0.0:1784405097.921048:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208800/0x24b3e2e6dcd7ad7f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405097.921064:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208800/0x24b3e2e6dcd7ad7f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405097.921072:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208800/0x24b3e2e6dcd7ad7f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405097.921079:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd56d208800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:0.0:1784405097.921098:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208800/0x24b3e2e6dcd7ad7f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405097.921107:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208800/0x24b3e2e6dcd7ad7f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405097.921126:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd54a6b8d00) 00010000:00010000:0.0:1784405097.921130:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1784405097.921136:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208800/0x24b3e2e6dcd7ad7f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784405097.921142:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd56d208800/0x24b3e2e6dcd7ad7f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784405097.921186:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784405097.921209:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729061760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1784405097.921294:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405097.921642:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd570593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+20:18831:x1871083707996160:12345-192.168.202.42@tcp:44:lhsmtool_posix.0 Request processed in 3723us (4112us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405097.921653:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 68 00010000:00010000:3.0:1784405097.922632:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.922643:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad2b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.922650:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.922655:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331de00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784405097.922659:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.922677:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad2b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.922692:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9dd54a6b8f00) 00010000:00010000:3.0:1784405097.922695:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784405097.922703:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad2b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.922710:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331de00/0x24b3e2e6dcd7ad2b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.922740:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad32 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.922746:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad32 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.922751:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad32 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.922756:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331c800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784405097.922758:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad32 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.922764:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad32 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.922771:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd54a6b8d00) 00010000:00010000:3.0:1784405097.922773:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784405097.922776:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad32 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.922787:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7ad32 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.922799:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7ae12 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.922805:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7ae12 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.922811:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7ae12 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.922816:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331d400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784405097.922819:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7ae12 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.922824:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7ae12 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.922831:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9dd54a6b8500) 00010000:00010000:3.0:1784405097.922833:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784405097.922836:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7ae12 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405097.922979:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729061760 00000100:00100000:2.0:1784405097.922990:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729061760 00000100:00100000:2.0:1784405097.923137:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784405097.923147:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729061760:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1784405097.923312:0:24225:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784405097.923316:0:24225:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1784405097.923319:0:24225:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784405097.923321:0:24225:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1784405098 -> 1784405098 00002000:00010000:2.0:1784405097.923329:0:24225:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1784405097.923397:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1871083729061760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 252us (2103us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1784405097.923405:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1784405097.923477:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dd443d86d80/2, rc 0, transno 12884901892 00000100:00100000:0.0:1784405097.923484:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729061760:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1784405097.924176:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7ae12 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924206:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd7ae97 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924213:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd7ae97 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924228:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd7ae97 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924233:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151ac00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784405097.924237:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd7ae97 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924244:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd7ae97 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924257:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:3.0:1784405097.924260:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784405097.924263:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd7ae97 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924269:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151ac00/0x24b3e2e6dcd7ae97 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924281:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7aeba lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924287:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7aeba lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924292:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7aeba lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924297:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442057000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784405097.924300:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7aeba lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924317:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7aeba lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924327:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:3.0:1784405097.924329:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784405097.924331:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7aeba lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924335:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442057000/0x24b3e2e6dcd7aeba lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924346:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7af00 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924351:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7af00 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924356:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7af00 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924360:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151bc00 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784405097.924363:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7af00 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924368:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7af00 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924375:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:3.0:1784405097.924377:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784405097.924379:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7af00 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924394:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151bc00/0x24b3e2e6dcd7af00 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924404:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7af85 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924409:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7af85 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924414:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7af85 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924419:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784405097.924421:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7af85 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924428:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7af85 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924436:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd57067d000) 00010000:00010000:3.0:1784405097.924439:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784405097.924442:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7af85 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.924447:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7af85 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405097.926100:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:0.0:1784405097.926244:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707996288 00000100:00100000:0.0:1784405097.926255:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707996288 00000100:00100000:0.0:1784405097.926317:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:0.0:1784405097.926327:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+7:2403:x1871083707996288:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1784405097.926440:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+7:2403:x1871083707996288:12345-192.168.202.42@tcp:16:lhsmtool_posix.0 Request processed in 115us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405097.926465:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 27 00000100:00100000:1.0:1784405097.929367:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405097.929714:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707996544 00000100:00100000:2.0:1784405097.929787:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707996544 00000100:00100000:2.0:1784405097.929883:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:2.0:1784405097.929894:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+14:18831:x1871083707996544:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784405097.929952:0:24942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784405097.929985:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd7af9a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78ff expref: 14 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.930007:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd57067d000) 00010000:00010000:2.0:1784405097.930013:0:24942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784405097.930050:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759c00/0x24b3e2e6dcd7afa8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.930064:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759c00/0x24b3e2e6dcd7afa8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.930073:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759c00/0x24b3e2e6dcd7afa8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784405097.930230:0:24942:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c8a02762 reply state 00000000af641ff3 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759c00/0x24b3e2e6dcd7afa8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.930241:0:24942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759c00/0x24b3e2e6dcd7afa8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.930247:0:24942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd57067d000) 00010000:00010000:2.0:1784405097.930265:0:24942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784405097.930268:0:24942:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784405097.930368:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+15:18831:x1871083707996544:12345-192.168.202.42@tcp:36:lhsmtool_posix.0 Request processed in 475us (1010us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1784405097.930375:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 69 00000100:00100000:1.0:1784405097.933358:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405097.933801:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707996672 00000100:00100000:2.0:1784405097.933812:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707996672 00000100:00100000:2.0:1784405097.933902:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:2.0:1784405097.933913:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5732e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+7:18831:x1871083707996672:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784405097.933933:0:24224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784405097.933954:0:24224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de764a38/0x24b3e2e6dcd7afaf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed790d expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.934001:0:24224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000023cf689/0x24b3e2e6dcd7afa1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7906 expref: 8 pid: 24222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.934011:0:24224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784405097.934015:0:24224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784405097.934020:0:24224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de764a38/0x24b3e2e6dcd7afaf lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed790d expref: 8 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.934079:0:24224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000023cf689/0x24b3e2e6dcd7afa1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7906 expref: 8 pid: 24222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.934096:0:24224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000023cf689/0x24b3e2e6dcd7afa1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7906 expref: 8 pid: 24222 timeout: 815 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405097.934133:0:24224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24224:1871083729061888:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784405097.934219:0:24224:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59c240 going to sleep for 11 seconds 00000100:00100000:2.0:1784405097.936069:0:24224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24224:1871083729061888:192.168.202.42@tcp:104: 00010000:00010000:2.0:1784405097.936102:0:24224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000de764a38/0x24b3e2e6dcd7afaf lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed790d expref: 8 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.936122:0:24224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548759600, rc 0) 00000100:00100000:2.0:1784405097.936184:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5732e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+8:18831:x1871083707996672:12345-192.168.202.42@tcp:101:lhsmtool_posix.0 Request processed in 2272us (2834us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405097.936192:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 28 00000100:00100000:3.0:1784405097.937485:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405097.937619:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707996800 00000100:00100000:2.0:1784405097.937628:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707996800 00010000:00010000:2.0:1784405097.937663:0:22704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000023cf689/0x24b3e2e6dcd7afa1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7906 expref: 8 pid: 24222 timeout: 815 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405097.937700:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:2.0:1784405097.937709:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+8:2404:x1871083707996800:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784405097.937754:0:22704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784405097.937777:0:22704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000023cf689/0x24b3e2e6dcd7afa1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7906 expref: 8 pid: 24222 timeout: 815 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.937790:0:22704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000023cf689/0x24b3e2e6dcd7afa1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7906 expref: 8 pid: 24222 timeout: 815 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.937824:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000023cf689/0x24b3e2e6dcd7afa1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7906 expref: 8 pid: 24222 timeout: 815 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.937840:0:22704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784405097.937845:0:22704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784405097.937899:0:22704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000de764a38/0x24b3e2e6dcd7afaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed790d expref: 7 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.937910:0:22704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de764a38/0x24b3e2e6dcd7afaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed790d expref: 7 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.937945:0:22704:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000de764a38/0x24b3e2e6dcd7afaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed790d expref: 7 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405097.937960:0:22704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:22704:1871083729062016:192.168.202.42@tcp:105: 00000100:00100000:2.0:1784405097.938032:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59c240 going to sleep for 11 seconds 00000100:00100000:1.0:1784405097.941309:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405097.941834:0:22704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:22704:1871083729062016:192.168.202.42@tcp:105: 00010000:00010000:2.0:1784405097.941887:0:22704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784405097.941947:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+7:2404:x1871083707996800:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 4238us (4465us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405097.941957:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 20 00000100:00100000:0.0:1784405097.943183:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707996928 00000100:00100000:0.0:1784405097.943193:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707996928 00000100:00100000:0.0:1784405097.943272:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:0.0:1784405097.943280:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573b98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+7:2403:x1871083707996928:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784405097.943434:0:24222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784405097.943438:0:24222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1784405097 00002000:00010000:0.0:1784405097.943440:0:24222:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1784405096 00002000:00010000:0.0:1784405097.943443:0:24222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1784405098 -> 1784405097 00002000:00010000:0.0:1784405097.943445:0:24222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1784405097.943503:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573b98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+8:2403:x1871083707996928:12345-192.168.202.42@tcp:2:lhsmtool_posix.0 Request processed in 223us (2203us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1784405097.943511:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 29 00000100:00100000:1.0:1784405097.945400:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405097.945687:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707997056 00000100:00100000:2.0:1784405097.945696:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707997056 00000100:00100000:2.0:1784405097.945740:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:2.0:1784405097.945760:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44242ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+8:2402:x1871083707997056:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784405097.945795:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000731939fb/0x24b3e2e6dcd7afb6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.945812:0:24225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000de764a38/0x24b3e2e6dcd7afaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed790d expref: 8 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.945818:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784405097.945822:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784405097.945825:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000731939fb/0x24b3e2e6dcd7afb6 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.945877:0:24225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000de764a38/0x24b3e2e6dcd7afaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed790d expref: 8 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.945887:0:24225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000de764a38/0x24b3e2e6dcd7afaf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed790d expref: 8 pid: 24224 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405097.945897:0:24225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24225:1871083729062144:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784405097.945974:0:24225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59c240 going to sleep for 11 seconds 00000100:00100000:3.0:1784405097.948738:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405097.948877:0:24225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24225:1871083729062144:192.168.202.42@tcp:104: 00010000:00010000:2.0:1784405097.948902:0:24225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000731939fb/0x24b3e2e6dcd7afb6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405097.949023:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707997184 00000100:00100000:1.0:1784405097.949030:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707997184 00010000:00010000:1.0:1784405097.949079:0:22703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000de764a38/0x24b3e2e6dcd7afaf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed790d expref: 9 pid: 24224 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405097.949118:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 21 00000100:00100000:1.0:1784405097.949127:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573f7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+9:2403:x1871083707997184:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784405097.949141:0:22703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784405097.949180:0:22703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000de764a38/0x24b3e2e6dcd7afaf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed790d expref: 9 pid: 24224 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.949192:0:22703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000de764a38/0x24b3e2e6dcd7afaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed790d expref: 9 pid: 24224 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.949215:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de764a38/0x24b3e2e6dcd7afaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed790d expref: 9 pid: 24224 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.949230:0:22703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784405097.949235:0:22703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784405097.949255:0:22703:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000731939fb/0x24b3e2e6dcd7afb6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.949264:0:22703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000731939fb/0x24b3e2e6dcd7afb6 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.949294:0:22703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784405097.949352:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573f7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+8:2403:x1871083707997184:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 225us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405097.949360:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 21 00010000:00010000:2.0:1784405097.949463:0:24225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000731939fb/0x24b3e2e6dcd7afb6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.949541:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000731939fb/0x24b3e2e6dcd7afb6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.949562:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000731939fb/0x24b3e2e6dcd7afb6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.949571:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000731939fb/0x24b3e2e6dcd7afb6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.949579:0:24225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000731939fb/0x24b3e2e6dcd7afb6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.949586:0:24225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758200 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784405097.949591:0:24225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000731939fb/0x24b3e2e6dcd7afb6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.949600:0:24225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000731939fb/0x24b3e2e6dcd7afb6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.949612:0:24225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000731939fb/0x24b3e2e6dcd7afb6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.949620:0:24225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000731939fb/0x24b3e2e6dcd7afb6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405097.949678:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44242ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+7:2402:x1871083707997056:12345-192.168.202.42@tcp:1:lhsmtool_posix.0 Request processed in 3918us (4283us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405097.949685:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 30 00000100:00100000:3.0:1784405097.951731:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405097.951794:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707997440 00000100:00100000:2.0:1784405097.951802:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707997440 00000100:00100000:2.0:1784405097.951891:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 70 00000100:00100000:2.0:1784405097.951903:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+15:18831:x1871083707997440:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784405097.951996:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7afbd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.952011:0:22717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7ae90 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78ab expref: 15 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.952018:0:22717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7afbd lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.952044:0:22717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7ae90 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78ab expref: 15 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.952053:0:22717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7ae90 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78ab expref: 15 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405097.952064:0:22717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22717:1871083729062272:192.168.202.42@tcp:104: 00000100:00100000:2.0:1784405097.952128:0:22717:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd57c59c240 going to sleep for 11 seconds 00000100:00100000:2.0:1784405097.954311:0:22717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22717:1871083729062272:192.168.202.42@tcp:104: 00010000:00010000:2.0:1784405097.954349:0:22717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7afbd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405097.954676:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405097.954732:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707997568 00000100:00100000:2.0:1784405097.954737:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707997568 00010000:00010000:2.0:1784405097.954764:0:22704:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7ae90 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78ab expref: 16 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405097.954793:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 22 00000100:00100000:2.0:1784405097.954799:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+16:2403:x1871083707997568:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784405097.954810:0:22704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784405097.954814:0:22704:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7ae90 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78ab expref: 16 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.954822:0:22704:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7ae90 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78ab expref: 16 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.954847:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151b200/0x24b3e2e6dcd7ae90 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78ab expref: 16 pid: 22719 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.954898:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:2.0:1784405097.954904:0:22704:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7af23 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78dc expref: 15 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.954915:0:22704:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7afbd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.954922:0:22704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7afbd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.954936:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7afbd lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.954969:0:22704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784405097.955018:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+15:2403:x1871083707997568:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 218us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405097.955026:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 22 00010000:00010000:3.0:1784405097.955123:0:22717:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7afbd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.955130:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7afbd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.955348:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7afc4 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.955360:0:22717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af8c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78f8 expref: 15 pid: 25762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.955366:0:22717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7afc4 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.955388:0:22717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af8c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78f8 expref: 15 pid: 25762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.955396:0:22717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af8c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78f8 expref: 15 pid: 25762 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405097.955405:0:22717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573f7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22717:1871083729062400:192.168.202.42@tcp:104: 00000100:00100000:3.0:1784405097.955581:0:22717:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443c13c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784405097.960388:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405097.960495:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707997696 00000100:00100000:1.0:1784405097.960506:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707997696 00010000:00010000:1.0:1784405097.960547:0:22702:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af8c lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78f8 expref: 16 pid: 25762 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784405097.960595:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 23 00000100:00100000:1.0:1784405097.960606:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd57cedcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+16:2403:x1871083707997696:12345-192.168.202.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784405097.960624:0:22702:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784405097.960631:0:22702:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af8c lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78f8 expref: 16 pid: 25762 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.960644:0:22702:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af8c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78f8 expref: 16 pid: 25762 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.960671:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd57067d000) 00010000:00010000:1.0:1784405097.960676:0:22702:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7afc4 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.960708:0:22702:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7afc4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.960716:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7afc4 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.960736:0:22702:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784405097.960797:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd57cedcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+16:2403:x1871083707997696:12345-192.168.202.42@tcp:103:ldlm_bl.0 Request processed in 192us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405097.960805:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 23 00010000:00010000:2.0:1784405097.961314:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7af8c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78f8 expref: 15 pid: 25762 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405097.961330:0:22717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573f7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22717:1871083729062400:192.168.202.42@tcp:104: 00010000:00010000:2.0:1784405097.961351:0:22717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7afc4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.961360:0:22717:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7afc4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.961366:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7afc4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784405097.961535:0:22717:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:2.0:1784405097.961659:0:22717:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:2.0:1784405097.961694:0:22717:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:2.0:1784405097.961776:0:22717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22717:1871083729062528:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784405097.961828:0:22717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405097.961898:0:22717:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd58169a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784405097.962130:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729062528 00000100:00100000:1.0:1784405097.962137:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729062528 00000100:00100000:1.0:1784405097.962191:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784405097.962200:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd443d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22717:x1871083729062528:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784405097.962288:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd443d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22717:x1871083729062528:12345-0@lo:1000:mdt00_000.0 Request processed in 89us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405097.962295:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784405097.962377:0:22717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d85180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22717:1871083729062528:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1784405097.962612:0:22717:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:3.0:1784405097.962658:0:22717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573f7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22717:1871083729062656:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784405097.962705:0:22717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784405097.962731:0:22717:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443c130c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784405097.962831:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729062656 00000100:00100000:1.0:1784405097.962931:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729062656 00000100:00100000:1.0:1784405097.963176:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784405097.963185:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22717:x1871083729062656:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784405097.963313:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22717:x1871083729062656:12345-0@lo:1000:mdt00_000.0 Request processed in 129us (607us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1784405097.963320:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784405097.963388:0:22717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573f7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22717:1871083729062656:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1784405097.963435:0:22717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7afc4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.963444:0:22717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7afc4 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.963450:0:22717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7afc4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.963457:0:22717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd58151a600 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784405097.963461:0:22717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7afc4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.963479:0:22717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7afc4 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.963494:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd57067d000) 00010000:00010000:3.0:1784405097.963497:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784405097.963502:0:22717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7afc4 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.963509:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a600/0x24b3e2e6dcd7afc4 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.963542:0:22717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7af1c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.963548:0:22717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7af1c lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.963554:0:22717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7af1c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.963569:0:22717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd442056400 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:3.0:1784405097.963572:0:22717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7af1c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.963577:0:22717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7af1c lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.963585:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:3.0:1784405097.963588:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784405097.963595:0:22717:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7af23 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78dc expref: 18 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.963605:0:22717:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7af23 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78dc expref: 18 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.963615:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7af23 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78dc expref: 18 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784405097.963670:0:22717:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dd58151a000/0x24b3e2e6dcd7af23 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed78dc expref: 18 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784405097.963682:0:22717:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd573f7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22717:1871083729062784:192.168.202.42@tcp:105: 00000100:00100000:3.0:1784405097.963739:0:22717:0:(client.c:2702:ptlrpc_set_wait()) set ffff9dd443c13a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784405097.971389:0:22717:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd573f7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22717:1871083729062784:192.168.202.42@tcp:105: 00010000:00010000:2.0:1784405097.971419:0:22717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7af1c lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.971449:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd442056400/0x24b3e2e6dcd7af1c lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.971502:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7afcb lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.971518:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7afcb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.971531:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7afcb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.971544:0:22717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7afcb lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.971551:0:22717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7afcb lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.971556:0:22717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7afcb lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.971562:0:22717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784405097.971566:0:22717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7afcb lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.971573:0:22717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7afcb lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.971584:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:2.0:1784405097.971587:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784405097.971591:0:22717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7afcb lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.971604:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7afcb lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.971614:0:22717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7afbd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.971620:0:22717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7afbd lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.971626:0:22717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7afbd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.971631:0:22717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784405097.971634:0:22717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7afbd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.971640:0:22717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7afbd lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.971649:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:2.0:1784405097.971651:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784405097.971653:0:22717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7afbd lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.971665:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7afbd lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405097.971840:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+18:18831:x1871083707997440:12345-192.168.202.42@tcp:57:lhsmtool_posix.0 Request processed in 19939us (20114us total) trans 12884901924 rc 0/0 00000100:00100000:2.0:1784405097.971891:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 70 00000020:00080000:2.0:1784405097.971910:0:22717:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1784405097.972690:0:22751:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1784405097.972697:0:22751:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784405097.972713:0:22751:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1784405097.972720:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1784405097.974106:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405097.974200:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707997952 00000100:00100000:1.0:1784405097.974210:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707997952 00000100:00100000:1.0:1784405097.974266:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:1.0:1784405097.974286:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+18:18830:x1871083707997952:12345-192.168.202.42@tcp:49:bash.0 00000100:00100000:1.0:1784405097.974433:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+18:18830:x1871083707997952:12345-192.168.202.42@tcp:49:bash.0 Request processed in 148us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405097.974440:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 12 00000100:00100000:3.0:1784405097.975718:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405097.976218:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707998080 00000100:00100000:1.0:1784405097.976226:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707998080 00000100:00100000:1.0:1784405097.976274:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 13 00000100:00100000:1.0:1784405097.976284:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd573f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+18:18831:x1871083707998080:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1784405097.977062:0:22721:0:(mdd_object.c:4016:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784405097.977099:0:22721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:1.0:1784405097.977140:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7afd2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.977169:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7afd2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.977182:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7afd2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.977191:0:22721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7afd2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.977198:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7afd2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.977204:0:22721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7afd2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.977224:0:22721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784405097.977326:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd573f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+20:18831:x1871083707998080:12345-192.168.202.42@tcp:35:lhsmtool_posix.0 Request processed in 1040us (1611us total) trans 12884901926 rc 0/0 00000100:00100000:1.0:1784405097.977348:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 13 00000020:00080000:1.0:1784405097.977353:0:22721:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784405097.980546:0:24945:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784405097.980562:0:24945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7afd2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.980574:0:24945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd57331c000 already unused, calling callback (ffffffffc0e93230) 00010000:00010000:2.0:1784405097.980578:0:24945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7afd2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.980587:0:24945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7afd2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.980605:0:24945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dd57067d000) 00010000:00010000:2.0:1784405097.980608:0:24945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784405097.980614:0:24945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7afd2 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.980619:0:24945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c000/0x24b3e2e6dcd7afd2 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405097.980635:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405097.980637:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784405097.980639:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784405097.981336:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405097.982166:0:24642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707998208 00000100:00100000:1.0:1784405097.982178:0:24642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707998208 00000100:00100000:1.0:1784405097.982248:0:24642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:1.0:1784405097.982259:0:24642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+7:18830:x1871083707998208:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1784405097.982276:0:24642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784405097.982296:0:24642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f460829/0x24b3e2e6dcd7afd9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7914 expref: -99 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784405097.982318:0:24642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a5bdc69, atime: 0x6a5bdc68, ctime: 0x6a5bdc69, blocks: 0x0 00010000:00010000:1.0:1784405097.982340:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=715s v=(0 0) 00010000:00010000:1.0:1784405097.982345:0:24642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784405097.982355:0:24642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f460829/0x24b3e2e6dcd7afd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7914 expref: 8 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.982372:0:24642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f460829/0x24b3e2e6dcd7afd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7914 expref: 8 pid: 24642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.982384:0:24642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331c400, rc 0) 00000100:00100000:1.0:1784405097.982726:0:24642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+8:18830:x1871083707998208:12345-192.168.202.42@tcp:101:bash.0 Request processed in 467us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405097.982734:0:24642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 31 00000100:00100000:0.0:1784405097.990780:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405097.990914:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707998336 00000100:00100000:1.0:1784405097.990924:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707998336 00000100:00100000:1.0:1784405097.990991:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 71 00000100:00100000:1.0:1784405097.991024:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd541327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+20:18830:x1871083707998336:12345-192.168.202.42@tcp:101:bash.0 00010000:00010000:1.0:1784405097.991057:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784405097.991082:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7afe0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed791b expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.991121:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7afe7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.991137:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7afe7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.991150:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7afe7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.991294:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331d400/0x24b3e2e6dcd7afe0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed791b expref: 22 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.991315:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd57331c800/0x24b3e2e6dcd7afe7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed791b expref: 21 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784405097.991324:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:1.0:1784405097.991326:0:22719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784405097.991330:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd57331c800, rc 0) 00000100:00100000:1.0:1784405097.991394:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd541327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+21:18830:x1871083707998336:12345-192.168.202.42@tcp:101:bash.0 Request processed in 372us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1784405097.991401:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 71 00000100:00100000:0.0:1784405097.997368:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:3.0:1784405097.997570:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707998592 00000100:00100000:3.0:1784405097.997580:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707998592 00000100:00100000:3.0:1784405097.997633:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 14 00000100:00100000:3.0:1784405097.997642:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44208f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+21:18830:x1871083707998592:12345-192.168.202.42@tcp:35:bash.0 00000001:00080000:3.0:1784405097.998030:0:22720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:3.0:1784405097.998282:0:22720:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:3.0:1784405097.998400:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44208f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+24:18830:x1871083707998592:12345-192.168.202.42@tcp:35:bash.0 Request processed in 757us (1041us total) trans 12884901929 rc 0/0 00000100:00100000:3.0:1784405097.998409:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 14 00000020:00080000:3.0:1784405097.998414:0:22720:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1784405098.114474:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405098.114681:0:25762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707998848 00000100:00100000:2.0:1784405098.114692:0:25762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707998848 00000100:00100000:2.0:1784405098.114748:0:25762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 72 00000100:00100000:2.0:1784405098.114758:0:25762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44208ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+24:18841:x1871083707998848:12345-192.168.202.42@tcp:101:lfs.0 00010000:00010000:2.0:1784405098.114785:0:25762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784405098.114806:0:25762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7afee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe3ea4cd182ed7922 expref: -99 pid: 25762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784405098.116363:0:25762:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784405098.116504:0:25762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7afee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7922 expref: 26 pid: 25762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.116519:0:25762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dd54a6b8900) 00010000:00010000:2.0:1784405098.116523:0:25762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784405098.116528:0:25762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7afee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.42@tcp remote: 0xe3ea4cd182ed7922 expref: 26 pid: 25762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.116543:0:25762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dd548758000, rc 0) 00000100:00100000:2.0:1784405098.116621:0:25762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44208ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+25:18841:x1871083707998848:12345-192.168.202.42@tcp:101:lfs.0 Request processed in 1864us (2166us total) trans 12884901930 rc 301/301 00000100:00100000:2.0:1784405098.116629:0:25762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 72 00000100:00100000:1.0:1784405098.125249:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:2.0:1784405098.125390:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707998976 00000100:00100000:2.0:1784405098.125401:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707998976 00000100:00100000:2.0:1784405098.125463:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 73 00000100:00100000:2.0:1784405098.125473:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd5445e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+25:18841:x1871083707998976:12345-192.168.202.42@tcp:34:lfs.0 00010000:00010000:2.0:1784405098.125555:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7affc lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125572:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7affc lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125585:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7affc lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125600:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7b003 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125621:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7b003 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125628:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7b003 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125704:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd7b00a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125713:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd7b00a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125720:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd7b00a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784405098.125765:0:22717:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd7b00a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125777:0:22717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7affc lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125784:0:22717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7affc lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125790:0:22717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7affc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125796:0:22717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758000 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784405098.125800:0:22717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7affc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125807:0:22717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7affc lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125826:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dd54a6b8d00) 00010000:00010000:2.0:1784405098.125829:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784405098.125833:0:22717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7affc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125839:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758000/0x24b3e2e6dcd7affc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125892:0:22717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7b003 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125905:0:22717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7b003 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125910:0:22717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7b003 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125915:0:22717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548759800 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784405098.125918:0:22717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7b003 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125924:0:22717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7b003 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125930:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9dd443416600) 00010000:00010000:2.0:1784405098.125933:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784405098.125935:0:22717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7b003 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125940:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548759800/0x24b3e2e6dcd7b003 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125963:0:22717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd7b00a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125969:0:22717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd7b00a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125974:0:22717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd7b00a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125980:0:22717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dd548758200 already unused, calling callback (ffffffffc1a9f4f0) 00010000:00010000:2.0:1784405098.125983:0:22717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd7b00a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125988:0:22717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd7b00a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.125995:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dd54a6b8b00) 00010000:00010000:2.0:1784405098.125997:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784405098.126000:0:22717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd7b00a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784405098.126006:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dd548758200/0x24b3e2e6dcd7b00a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784405098.126080:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd5445e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+25:18841:x1871083707998976:12345-192.168.202.42@tcp:34:lfs.0 Request processed in 608us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405098.126087:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 73 00000100:00100000:0.0:1784405098.129054:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.42@tcp (source: 12345-192.168.202.42@tcp) 00000100:00100000:1.0:1784405098.133668:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083707999232 00000100:00100000:1.0:1784405098.133684:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083707999232 00000100:00100000:1.0:1784405098.133822:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.42@tcp, seq: 15 00000100:00100000:1.0:1784405098.133833:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44208f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+25:18841:x1871083707999232:12345-192.168.202.42@tcp:35:lfs.0 00000100:00100000:1.0:1784405098.134093:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44208f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bfe57d2-0189-4fcc-8706-d3fc83c1de0c+26:18841:x1871083707999232:12345-192.168.202.42@tcp:35:lfs.0 Request processed in 261us (5047us total) trans 12884901931 rc 0/0 00000100:00100000:1.0:1784405098.134101:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.42@tcp, seq: 15 00010000:00010000:0.0:1784405098.499089:0:22706:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784405099.011041:0:22751:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1784405099.011049:0:22751:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784405099.011075:0:22751:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1784405099.011082:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1784405099.527609:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784405099.559299:0:25800:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:0.0:1784405100.420503:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44208df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729062912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784405100.420578:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405100.420634:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729062912 00000100:00100000:0.0:1784405100.420642:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729062912 00000100:00100000:0.0:1784405100.420696:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784405100.420707:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44208c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729062912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784405100.420734:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784405100.420775:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44208c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1871083729062912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405100.420782:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1784405100.420815:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784405100.420989:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44208df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1871083729062912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784405100.421521:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44208df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3648:1871083729063040:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.421558:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405100.421585:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44208dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729063552:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.421608:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405100.421625:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44208e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083729064064:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.421649:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405100.421667:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784405100.421672:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44208c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729063168:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.421712:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405100.421733:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44208ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729063680:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.421766:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405100.421784:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44208c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083729064192:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.421815:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784405100.422504:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729064064 00000100:00100000:2.0:1784405100.422509:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729064064 00000100:00100000:2.0:1784405100.422549:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729064192 00000100:00100000:2.0:1784405100.422557:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729064192 00000100:00100000:2.0:1784405100.422580:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784405100.422587:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44208f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083729064064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405100.422633:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44208f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1871083729064064:12345-0@lo:400:kworker.0 Request processed in 47us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405100.422639:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784405100.422655:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784405100.422661:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4430cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083729064192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784405100.422684:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4430cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1871083729064192:12345-0@lo:400:kworker.0 Request processed in 24us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1784405100.422689:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1784405100.422710:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784405100.422713:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784405100.426619:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729063040 00000100:00100000:0.0:1784405100.426633:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729063040 00000100:00100000:0.0:1784405100.426696:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1784405100.426705:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd54394fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:3648:x1871083729063040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.426804:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd54394fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:446d3b01-f4c0-4b8c-bf87-7caa910a24b3+24:3648:x1871083729063040:12345-0@lo:400:kworker.0 Request processed in 99us (5244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405100.426812:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1784405100.426864:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729063552 00000100:00100000:0.0:1784405100.426868:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729063552 00000100:00100000:0.0:1784405100.426899:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729063168 00000100:00100000:0.0:1784405100.426902:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729063168 00000100:00100000:0.0:1784405100.426915:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784405100.426921:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd44208d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729063552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.426957:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd44208d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729063552:12345-0@lo:400:kworker.0 Request processed in 36us (5348us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405100.426962:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784405100.426974:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784405100.426978:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4430cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729063168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.427004:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4430cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1871083729063168:12345-0@lo:400:kworker.0 Request processed in 26us (5292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405100.427009:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784405100.427031:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729063680 00000100:00100000:0.0:1784405100.427034:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729063680 00000100:00100000:0.0:1784405100.427077:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784405100.427093:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4430cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729063680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.427125:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4430cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729063680:12345-0@lo:400:kworker.0 Request processed in 33us (5359us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405100.427130:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784405100.427174:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44208d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729063296:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.427209:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405100.427239:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44208e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729063808:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.427259:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405100.427278:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44208d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083729064320:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.427300:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405100.427327:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784405100.427334:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44208ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083729063424:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.427354:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405100.427371:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44208fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083729063936:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.427390:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405100.427404:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd44208ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083729064448:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.427422:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405100.427445:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729063296 00000100:00100000:0.0:1784405100.427449:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729063296 00000100:00100000:0.0:1784405100.427469:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729063808 00000100:00100000:0.0:1784405100.427472:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729063808 00000100:00100000:0.0:1784405100.427487:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784405100.427492:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4430cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1871083729063296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.427527:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4430cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1871083729063296:12345-0@lo:400:kworker.0 Request processed in 34us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405100.427533:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784405100.427552:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784405100.427558:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4430cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729063808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.427587:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4430cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1871083729063808:12345-0@lo:400:kworker.0 Request processed in 29us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405100.427593:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784405100.427638:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44208d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1871083729063296:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.427649:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44208e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1871083729063808:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.427676:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9dd443d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729064576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784405100.427701:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784405100.427725:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44208c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1871083729063168:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.427738:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44208ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729063680:0@lo:400:kworker.0 00010000:00080000:0.0:1784405100.427753:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44208c700 x1871083729064192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784405100.427764:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44208c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1871083729064192:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.427773:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44208df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:446d3b01-f4c0-4b8c-bf87-7caa910a24b3:3648:1871083729063040:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.427782:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44208dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729063552:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.427791:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44208e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1871083729064064:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.427820:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729064576 00000100:00100000:0.0:1784405100.427824:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729064576 00000100:00100000:0.0:1784405100.427846:0:24226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784405100.427871:0:24226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4430cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729064576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784405100.427885:0:24226:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784405100.427926:0:24226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4430cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1871083729064576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405100.427932:0:24226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784405100.427963:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd443d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1871083729064576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784405100.428001:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729064320 00000100:00100000:0.0:1784405100.428004:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729064320 00000100:00100000:0.0:1784405100.428027:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729063424 00000100:00100000:0.0:1784405100.428029:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729063424 00000100:00100000:0.0:1784405100.428039:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729063936 00000100:00100000:0.0:1784405100.428042:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729063936 00000100:00100000:0.0:1784405100.428050:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871083729064448 00000100:00100000:0.0:1784405100.428052:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871083729064448 00000100:00100000:0.0:1784405100.428067:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784405100.428072:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4430cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083729064320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.428105:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4430cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1871083729064320:12345-0@lo:400:kworker.0 Request processed in 33us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405100.428111:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784405100.428123:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784405100.428129:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4430ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083729063424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.428169:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4430ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1871083729063424:12345-0@lo:400:kworker.0 Request processed in 40us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405100.428175:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784405100.428187:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784405100.428193:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4430cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083729063936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.428217:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4430cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1871083729063936:12345-0@lo:400:kworker.0 Request processed in 24us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405100.428223:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784405100.428242:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784405100.428248:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9dd4430cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083729064448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.428276:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9dd4430cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1871083729064448:12345-0@lo:400:kworker.0 Request processed in 29us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1784405100.428283:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784405100.428311:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44208ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1871083729063424:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.428321:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44208fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1871083729063936:0@lo:400:kworker.0 00010000:00080000:0.0:1784405100.428329:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dd44208ca80 x1871083729064448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784405116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784405100.428339:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44208ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1871083729064448:0@lo:400:kworker.0 00000100:00100000:0.0:1784405100.428347:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9dd44208d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1871083729064320:0@lo:400:kworker.0 00000100:00080000:2.0:1784405100.429377:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784405100.429385:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784405100.429389:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784405100.429391:0:22713:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784405100.547274:0:24945:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14543 lines, 14543 kept, 0 dropped, 0 bad.